[VOTE] FLIP-131: Consolidate the user-facing Dataflow SDKs/APIs (and deprecate the DataSet API)

[Aljoscha Krettek-2]

Hi all,

After the discussion in [1], I would like to open a voting thread for
FLIP-131 (https://s.apache.org/FLIP-131) [2] which discusses the
deprecation of the DataSet API and future work on the DataStream API and
Table API for bounded (batch) execution.

The vote will be open until September 7 (72h + weekend), unless there is
an objection or not enough votes.

Regards,
Aljoscha

[1]
https://lists.apache.org/thread.html/r4f24c4312cef7270a1349c39b89fb1184c84065944b43aedf9cfba6a%40%3Cdev.flink.apache.org%3E
[2]
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866741

[Yun Gao]

Very thanks for bring this up!  +1 for deprecating the DataSet API and providing a unified streaming/batch programming model to users.

Best,
 Yun


------------------------------------------------------------------
Sender:Aljoscha Krettek<[hidden email]>
Date:2020/09/02 19:22:51
Recipient:Flink Dev<[hidden email]>
Theme:[VOTE] FLIP-131: Consolidate the user-facing Dataflow SDKs/APIs (and deprecate the DataSet API)

Hi all,

After the discussion in [1], I would like to open a voting thread for
FLIP-131 (https://s.apache.org/FLIP-131) [2] which discusses the
deprecation of the DataSet API and future work on the DataStream API and
Table API for bounded (batch) execution.

The vote will be open until September 7 (72h + weekend), unless there is
an objection or not enough votes.

Regards,
Aljoscha

[1]
https://lists.apache.org/thread.html/r4f24c4312cef7270a1349c39b89fb1184c84065944b43aedf9cfba6a%40%3Cdev.flink.apache.org%3E
[2]
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866741

[dwysakowicz]

+1

I think it gives a clear idea why we should deprecate and eventually
remove the DataSet API.

Best,

Dawid

On 03/09/2020 09:37, Yun Gao wrote:

> Very thanks for bring this up!  +1 for deprecating the DataSet API and providing a unified streaming/batch programming model to users.
>
> Best,
>  Yun
>
>
> ------------------------------------------------------------------
> Sender:Aljoscha Krettek<[hidden email]>
> Date:2020/09/02 19:22:51
> Recipient:Flink Dev<[hidden email]>
> Theme:[VOTE] FLIP-131: Consolidate the user-facing Dataflow SDKs/APIs (and deprecate the DataSet API)
>
> Hi all,
>
> After the discussion in [1], I would like to open a voting thread for
> FLIP-131 (https://s.apache.org/FLIP-131) [2] which discusses the
> deprecation of the DataSet API and future work on the DataStream API and
> Table API for bounded (batch) execution.
>
> The vote will be open until September 7 (72h + weekend), unless there is
> an objection or not enough votes.
>
> Regards,
> Aljoscha
>
> [1]
> https://lists.apache.org/thread.html/r4f24c4312cef7270a1349c39b89fb1184c84065944b43aedf9cfba6a%40%3Cdev.flink.apache.org%3E
> [2]
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866741

[Guowei Ma]

+1
Looking forward to having a unified datastream api.
Best,
Guowei


On Thu, Sep 3, 2020 at 3:46 PM Dawid Wysakowicz <[hidden email]>
wrote:

> +1
>
> I think it gives a clear idea why we should deprecate and eventually
> remove the DataSet API.
>
> Best,
>
> Dawid
>
> On 03/09/2020 09:37, Yun Gao wrote:
> > Very thanks for bring this up!  +1 for deprecating the DataSet API and
> providing a unified streaming/batch programming model to users.
> >
> > Best,
> >  Yun
> >
> >
> > ------------------------------------------------------------------
> > Sender:Aljoscha Krettek<[hidden email]>
> > Date:2020/09/02 19:22:51
> > Recipient:Flink Dev<[hidden email]>
> > Theme:[VOTE] FLIP-131: Consolidate the user-facing Dataflow SDKs/APIs
> (and deprecate the DataSet API)
> >
> > Hi all,
> >
> > After the discussion in [1], I would like to open a voting thread for
> > FLIP-131 (https://s.apache.org/FLIP-131) [2] which discusses the
> > deprecation of the DataSet API and future work on the DataStream API and
> > Table API for bounded (batch) execution.
> >
> > The vote will be open until September 7 (72h + weekend), unless there is
> > an objection or not enough votes.
> >
> > Regards,
> > Aljoscha
> >
> > [1]
> >
> https://lists.apache.org/thread.html/r4f24c4312cef7270a1349c39b89fb1184c84065944b43aedf9cfba6a%40%3Cdev.flink.apache.org%3E
> > [2]
> >
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866741
>
>

[Piotr Nowojski-5]

+1

czw., 3 wrz 2020 o 10:08 Guowei Ma <[hidden email]> napisał(a):

> +1
> Looking forward to having a unified datastream api.
> Best,
> Guowei
>
>
> On Thu, Sep 3, 2020 at 3:46 PM Dawid Wysakowicz <[hidden email]>
> wrote:
>
> > +1
> >
> > I think it gives a clear idea why we should deprecate and eventually
> > remove the DataSet API.
> >
> > Best,
> >
> > Dawid
> >
> > On 03/09/2020 09:37, Yun Gao wrote:
> > > Very thanks for bring this up!  +1 for deprecating the DataSet API and
> > providing a unified streaming/batch programming model to users.
> > >
> > > Best,
> > >  Yun
> > >
> > >
> > > ------------------------------------------------------------------
> > > Sender:Aljoscha Krettek<[hidden email]>
> > > Date:2020/09/02 19:22:51
> > > Recipient:Flink Dev<[hidden email]>
> > > Theme:[VOTE] FLIP-131: Consolidate the user-facing Dataflow SDKs/APIs
> > (and deprecate the DataSet API)
> > >
> > > Hi all,
> > >
> > > After the discussion in [1], I would like to open a voting thread for
> > > FLIP-131 (https://s.apache.org/FLIP-131) [2] which discusses the
> > > deprecation of the DataSet API and future work on the DataStream API
> and
> > > Table API for bounded (batch) execution.
> > >
> > > The vote will be open until September 7 (72h + weekend), unless there
> is
> > > an objection or not enough votes.
> > >
> > > Regards,
> > > Aljoscha
> > >
> > > [1]
> > >
> >
> https://lists.apache.org/thread.html/r4f24c4312cef7270a1349c39b89fb1184c84065944b43aedf9cfba6a%40%3Cdev.flink.apache.org%3E
> > > [2]
> > >
> >
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866741
> >
> >
>

[David Anderson-3]

+1


On Thu, Sep 3, 2020 at 3:06 PM Piotr Nowojski <[hidden email]> wrote:

> +1
>
> czw., 3 wrz 2020 o 10:08 Guowei Ma <[hidden email]> napisał(a):
>
> > +1
> > Looking forward to having a unified datastream api.
> > Best,
> > Guowei
> >
> >
> > On Thu, Sep 3, 2020 at 3:46 PM Dawid Wysakowicz <[hidden email]>
> > wrote:
> >
> > > +1
> > >
> > > I think it gives a clear idea why we should deprecate and eventually
> > > remove the DataSet API.
> > >
> > > Best,
> > >
> > > Dawid
> > >
> > > On 03/09/2020 09:37, Yun Gao wrote:
> > > > Very thanks for bring this up!  +1 for deprecating the DataSet API
> and
> > > providing a unified streaming/batch programming model to users.
> > > >
> > > > Best,
> > > >  Yun
> > > >
> > > >
> > > > ------------------------------------------------------------------
> > > > Sender:Aljoscha Krettek<[hidden email]>
> > > > Date:2020/09/02 19:22:51
> > > > Recipient:Flink Dev<[hidden email]>
> > > > Theme:[VOTE] FLIP-131: Consolidate the user-facing Dataflow SDKs/APIs
> > > (and deprecate the DataSet API)
> > > >
> > > > Hi all,
> > > >
> > > > After the discussion in [1], I would like to open a voting thread for
> > > > FLIP-131 (https://s.apache.org/FLIP-131) [2] which discusses the
> > > > deprecation of the DataSet API and future work on the DataStream API
> > and
> > > > Table API for bounded (batch) execution.
> > > >
> > > > The vote will be open until September 7 (72h + weekend), unless there
> > is
> > > > an objection or not enough votes.
> > > >
> > > > Regards,
> > > > Aljoscha
> > > >
> > > > [1]
> > > >
> > >
> >
> https://lists.apache.org/thread.html/r4f24c4312cef7270a1349c39b89fb1184c84065944b43aedf9cfba6a%40%3Cdev.flink.apache.org%3E
> > > > [2]
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866741
> > >
> > >
> >
>

[Zhu Zhu]

+1

From the viewpoint of a developer, too many APIs also adds complexity and
risk
to the code change for job compilation stage and runtime stage.
Looking forward to the day that we can drop DataSet API and having a unified
one.

Thanks,
Zhu

David Anderson <[hidden email]> 于2020年9月4日周五 上午2:23写道：

> +1
>
>
> On Thu, Sep 3, 2020 at 3:06 PM Piotr Nowojski <[hidden email]>
> wrote:
>
> > +1
> >
> > czw., 3 wrz 2020 o 10:08 Guowei Ma <[hidden email]> napisał(a):
> >
> > > +1
> > > Looking forward to having a unified datastream api.
> > > Best,
> > > Guowei
> > >
> > >
> > > On Thu, Sep 3, 2020 at 3:46 PM Dawid Wysakowicz <
> [hidden email]>
> > > wrote:
> > >
> > > > +1
> > > >
> > > > I think it gives a clear idea why we should deprecate and eventually
> > > > remove the DataSet API.
> > > >
> > > > Best,
> > > >
> > > > Dawid
> > > >
> > > > On 03/09/2020 09:37, Yun Gao wrote:
> > > > > Very thanks for bring this up!  +1 for deprecating the DataSet API
> > and
> > > > providing a unified streaming/batch programming model to users.
> > > > >
> > > > > Best,
> > > > >  Yun
> > > > >
> > > > >
> > > > > ------------------------------------------------------------------
> > > > > Sender:Aljoscha Krettek<[hidden email]>
> > > > > Date:2020/09/02 19:22:51
> > > > > Recipient:Flink Dev<[hidden email]>
> > > > > Theme:[VOTE] FLIP-131: Consolidate the user-facing Dataflow
> SDKs/APIs
> > > > (and deprecate the DataSet API)
> > > > >
> > > > > Hi all,
> > > > >
> > > > > After the discussion in [1], I would like to open a voting thread
> for
> > > > > FLIP-131 (https://s.apache.org/FLIP-131) [2] which discusses the
> > > > > deprecation of the DataSet API and future work on the DataStream
> API
> > > and
> > > > > Table API for bounded (batch) execution.
> > > > >
> > > > > The vote will be open until September 7 (72h + weekend), unless
> there
> > > is
> > > > > an objection or not enough votes.
> > > > >
> > > > > Regards,
> > > > > Aljoscha
> > > > >
> > > > > [1]
> > > > >
> > > >
> > >
> >
> https://lists.apache.org/thread.html/r4f24c4312cef7270a1349c39b89fb1184c84065944b43aedf9cfba6a%40%3Cdev.flink.apache.org%3E
> > > > > [2]
> > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866741
> > > >
> > > >
> > >
> >
>

[Aljoscha Krettek-2]

Hi all,

The voting time for FLIP-131 [1] has passed. I'm closing the vote now.

Including my implicit vote, there were 7 + 1 votes, 5 of which are binding:

- Dawid Wysakowicz (binding)
- Piotr Nowojski (binding)
- David Anderson (binding)
- Zhu Zhu (binding)
- Aljoscha Krettek

There were no -1 votes.

Thus, the FLIP has been accepted. I'll update the FLIP and the overview
table accordingly.

[1]
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866741

Best,
Aljoscha

On 04.09.20 02:56, Zhu Zhu wrote:

> +1
>
>  From the viewpoint of a developer, too many APIs also adds complexity and
> risk
> to the code change for job compilation stage and runtime stage.
> Looking forward to the day that we can drop DataSet API and having a unified
> one.
>
> Thanks,
> Zhu
>
> David Anderson <[hidden email]> 于2020年9月4日周五 上午2:23写道：
>
>> +1
>>
>>
>> On Thu, Sep 3, 2020 at 3:06 PM Piotr Nowojski <[hidden email]>
>> wrote:
>>
>>> +1
>>>
>>> czw., 3 wrz 2020 o 10:08 Guowei Ma <[hidden email]> napisał(a):
>>>
>>>> +1
>>>> Looking forward to having a unified datastream api.
>>>> Best,
>>>> Guowei
>>>>
>>>>
>>>> On Thu, Sep 3, 2020 at 3:46 PM Dawid Wysakowicz <
>> [hidden email]>
>>>> wrote:
>>>>
>>>>> +1
>>>>>
>>>>> I think it gives a clear idea why we should deprecate and eventually
>>>>> remove the DataSet API.
>>>>>
>>>>> Best,
>>>>>
>>>>> Dawid
>>>>>
>>>>> On 03/09/2020 09:37, Yun Gao wrote:
>>>>>> Very thanks for bring this up!  +1 for deprecating the DataSet API
>>> and
>>>>> providing a unified streaming/batch programming model to users.
>>>>>>
>>>>>> Best,
>>>>>>   Yun
>>>>>>
>>>>>>
>>>>>> ------------------------------------------------------------------
>>>>>> Sender:Aljoscha Krettek<[hidden email]>
>>>>>> Date:2020/09/02 19:22:51
>>>>>> Recipient:Flink Dev<[hidden email]>
>>>>>> Theme:[VOTE] FLIP-131: Consolidate the user-facing Dataflow
>> SDKs/APIs
>>>>> (and deprecate the DataSet API)
>>>>>>
>>>>>> Hi all,
>>>>>>
>>>>>> After the discussion in [1], I would like to open a voting thread
>> for
>>>>>> FLIP-131 (https://s.apache.org/FLIP-131) [2] which discusses the
>>>>>> deprecation of the DataSet API and future work on the DataStream
>> API
>>>> and
>>>>>> Table API for bounded (batch) execution.
>>>>>>
>>>>>> The vote will be open until September 7 (72h + weekend), unless
>> there
>>>> is
>>>>>> an objection or not enough votes.
>>>>>>
>>>>>> Regards,
>>>>>> Aljoscha
>>>>>>
>>>>>> [1]
>>>>>>
>>>>>
>>>>
>>>
>> https://lists.apache.org/thread.html/r4f24c4312cef7270a1349c39b89fb1184c84065944b43aedf9cfba6a%40%3Cdev.flink.apache.org%3E
>>>>>> [2]
>>>>>>
>>>>>
>>>>
>>>
>> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866741
>>>>>
>>>>>
>>>>
>>>
>>
>