Streaming windowing rework

[Henry Saputra]

If people are ok, I propose to do the 6pm (CET) to make sure Stephan
can join too.

Would that still work for everybody?

Does Kostas or Robert know how to record hangout to publish it to
mailing list as before? I assume we will do Google hangout?

- Henry

On Mon, Dec 8, 2014 at 6:58 AM, Stephan Ewen <[hidden email]> wrote:

> I have to see whether I can make it, I might still be on my way back from
> Amsterdam (giving a talk at the Netherlands Hadoop User Group). I might be
> a bit late and only join at 6pm (CET) / 9am (PST)
>
> Greetings,
> Stephan
>
> On Mon, Dec 8, 2014 at 12:22 PM, Paris Carbone <[hidden email]>
> wrote:
>
>> Hey,
>>
>> @Gyula I can help with the discussion content doc
>> @Gianmarco It will be great to have you! We will also keep you posted on
>> the Samoa integration.
>> @Henry, correct, it’s 8:30am PST.
>>
>> cheers
>> Paris
>>
>>
>> > On 08 Dec 2014, at 11:34, Gyula Fora <[hidden email]> wrote:
>> >
>> > Hey,
>> >
>> > I’m glad that you want to join. We will post a hangout link here later :)
>> >
>> > Can someone please help me with setting these things up?
>> >
>> > Cheers,
>> > Gyula
>> >
>> >> On 08 Dec 2014, at 11:16, Gianmarco De Francisci Morales <
>> [hidden email]> wrote:
>> >>
>> >> Hi,
>> >> I'm one of the developers of SAMOA and I'd be happy to participate as
>> well.
>> >> How should I connect?
>> >>
>> >> Thanks,
>> >>
>> >>
>> >> --
>> >> Gianmarco
>> >>
>> >> On 8 December 2014 at 09:28, Asterios Katsifodimos <
>> >> [hidden email]> wrote:
>> >>
>> >>> Great work, +1 for Friday!
>> >>>
>> >>> Cheers,
>> >>> Asterios
>> >>>> On 08 Dec 2014, at 00:31, Henry Saputra <[hidden email]>
>> wrote:
>> >>>>
>> >>>> Thanks Gyula,
>> >>>>
>> >>>> Just checking it will be 8:30am PST?
>> >>>>
>> >>>> To make it more productive please have some kind of simple design doc
>> or
>> >>>> proposal with preso style to help us discuss each proposed work.
>> >>>>
>> >>>> Following the apache way, we then need to create Jira ticket and
>> attach
>> >>> it
>> >>>> for other whom cannot attend the hangout to review and chime in.
>> >>>> Any Final decisions need to happen in dev list via emails or comments
>> in
>> >>>> Jira.
>> >>>>
>> >>>> On Sunday, December 7, 2014, Paris Carbone <[hidden email]> wrote:
>> >>>>
>> >>>>> +1
>> >>>>>
>> >>>>> I agree it will be nice to discuss our upcoming directions and ideas
>> >>> with
>> >>>>> anyone that is interested to give feedback.
>> >>>>> One suggested time for the hangout is next Friday 12 Dec. 17:30pm
>> >>> (GMT+1).
>> >>>>> I hope it is cross-atlantic friendly enough. Is that generally ok for
>> >>> the
>> >>>>> rest?
>> >>>>>
>> >>>>> Paris
>> >>>>>
>> >>>>> PS: thanks for the hilarious introduction of the windowing semantics
>> >>>>> everyone :)
>> >>>>>
>> >>>>> ________________________________________
>> >>>>> From: Kostas Tzoumas [[hidden email] <javascript:;>]
>> >>>>> Sent: Sunday, December 07, 2014 1:23 PM
>> >>>>> To: [hidden email] <javascript:;>
>> >>>>> Subject: Re: Streaming windowing rework
>> >>>>>
>> >>>>> +1 great idea
>> >>>>>
>> >>>>> On Sun, Dec 7, 2014 at 10:35 AM, Gyula Fóra <[hidden email]
>> >>>>> <javascript:;>> wrote:
>> >>>>>
>> >>>>>> Hey Henry,
>> >>>>>>
>> >>>>>> (I am resending this mail because it seems it didnt make it through
>> the
>> >>>>>> mail system)
>> >>>>>>
>> >>>>>> I suggest to have a public hangout sometimes on the current work we
>> are
>> >>>>>> doing and our plans on streaming.
>> >>>>>>
>> >>>>>> We have actually put together a list of topics that we want to work
>> on
>> >>>>> next
>> >>>>>> year as we will have a quite large Flink team at SICS from January:
>> >>>>> Paris,
>> >>>>>> Jonas, Me and later Vasia.
>> >>>>>>
>> >>>>>> Basically the topics are:
>> >>>>>> - Windowing semantics and multiquery optimisations (thats mainly
>> Jonas'
>> >>>>>> thesis topic)
>> >>>>>> - Different fault tolerance approaches
>> >>>>>> - Connecting batch and streaming api ('lambda')
>> >>>>>> - Streaming graph algorithms
>> >>>>>> - Samoa for Flink (and streaming machine learning in general)
>> >>>>>>
>> >>>>>> So lets start a series of public hangout calls to discuss these
>> >>> topics, I
>> >>>>>> would suggest one sometimes next week when it is suitable.
>> >>>>>>
>> >>>>>> Regards,
>> >>>>>> Gyula
>> >>>>>>
>> >>>>>> On Sat, Dec 6, 2014 at 12:56 AM, Henry Saputra <
>> >>> [hidden email]
>> >>>>> <javascript:;>>
>> >>>>>> wrote:
>> >>>>>>
>> >>>>>>> We actually need to bring these work come to light early so we
>> could
>> >>>>>>> give feedback before getting to deep.
>> >>>>>>>
>> >>>>>>> Marton, could you encourage Paris and Jonas to publish or share
>> their
>> >>>>>>> thoughts about the work they are doing?
>> >>>>>>>
>> >>>>>>> Would love to give some feedbacks.
>> >>>>>>>
>> >>>>>>> - Henry
>> >>>>>>>
>> >>>>>>> On Fri, Dec 5, 2014 at 12:38 PM, Kostas Tzoumas <
>> [hidden email]
>> >>>>> <javascript:;>>
>> >>>>>>> wrote:
>> >>>>>>>> Super!
>> >>>>>>>>
>> >>>>>>>> Paris and Jonas have been doing a lot of "silent" work (= not very
>> >>>>>>> visible
>> >>>>>>>> in the mailing list) recently. Looking forward to seeing this
>> coming
>> >>>>>> in.
>> >>>>>>>>
>> >>>>>>>> On Fri, Dec 5, 2014 at 8:00 PM, Henry Saputra <
>> >>>>> [hidden email] <javascript:;>
>> >>>>>>>
>> >>>>>>>> wrote:
>> >>>>>>>>
>> >>>>>>>>> Nice! Looking forward to it
>> >>>>>>>>>
>> >>>>>>>>> On Fri, Dec 5, 2014 at 9:34 AM, Márton Balassi <
>> >>>>>>> [hidden email] <javascript:;>>
>> >>>>>>>>> wrote:
>> >>>>>>>>>> Hey,
>> >>>>>>>>>>
>> >>>>>>>>>> As you may know in some European countries Santa Claus comes on
>> >>>>> the
>> >>>>>>> 6th
>> >>>>>>>>> of
>> >>>>>>>>>> December, Saint Nicolas Day - from Finland.
>> >>>>>>>>>>
>> >>>>>>>>>> As Flink is not yet very active in Finland our Sweden team
>> stepped
>> >>>>>> in
>> >>>>>>> and
>> >>>>>>>>>> gave us a big present with a huge rework on the windowing
>> >>>>> semantics
>> >>>>>> -
>> >>>>>>>>> this
>> >>>>>>>>>> is the implementation of the ideas that were posed the Stockholm
>> >>>>>>>>> hackathon
>> >>>>>>>>>> in October.
>> >>>>>>>>>>
>> >>>>>>>>>> Big thanks to Jonas, Paris and Gyula. Jonas is posting a
>> detailed
>> >>>>>>> intro
>> >>>>>>>>> to
>> >>>>>>>>>> the new features here soon.
>> >>>>>>>>>>
>> >>>>>>>>>> Marton
>> >>>>>>>>>
>> >>>>>>>
>> >>>>>>
>> >>>>>
>> >>>
>> >>>
>> >
>>
>>

[Henry Saputra]

HI Paris, this is great news!

Thanks for the confirmation of time =)

On Mon, Dec 8, 2014 at 3:22 AM, Paris Carbone <[hidden email]> wrote:

> Hey,
>
> @Gyula I can help with the discussion content doc
> @Gianmarco It will be great to have you! We will also keep you posted on the Samoa integration.
> @Henry, correct, it’s 8:30am PST.
>
> cheers
> Paris
>
>
>> On 08 Dec 2014, at 11:34, Gyula Fora <[hidden email]> wrote:
>>
>> Hey,
>>
>> I’m glad that you want to join. We will post a hangout link here later :)
>>
>> Can someone please help me with setting these things up?
>>
>> Cheers,
>> Gyula
>>
>>> On 08 Dec 2014, at 11:16, Gianmarco De Francisci Morales <[hidden email]> wrote:
>>>
>>> Hi,
>>> I'm one of the developers of SAMOA and I'd be happy to participate as well.
>>> How should I connect?
>>>
>>> Thanks,
>>>
>>>
>>> --
>>> Gianmarco
>>>
>>> On 8 December 2014 at 09:28, Asterios Katsifodimos <
>>> [hidden email]> wrote:
>>>
>>>> Great work, +1 for Friday!
>>>>
>>>> Cheers,
>>>> Asterios
>>>>> On 08 Dec 2014, at 00:31, Henry Saputra <[hidden email]> wrote:
>>>>>
>>>>> Thanks Gyula,
>>>>>
>>>>> Just checking it will be 8:30am PST?
>>>>>
>>>>> To make it more productive please have some kind of simple design doc or
>>>>> proposal with preso style to help us discuss each proposed work.
>>>>>
>>>>> Following the apache way, we then need to create Jira ticket and attach
>>>> it
>>>>> for other whom cannot attend the hangout to review and chime in.
>>>>> Any Final decisions need to happen in dev list via emails or comments in
>>>>> Jira.
>>>>>
>>>>> On Sunday, December 7, 2014, Paris Carbone <[hidden email]> wrote:
>>>>>
>>>>>> +1
>>>>>>
>>>>>> I agree it will be nice to discuss our upcoming directions and ideas
>>>> with
>>>>>> anyone that is interested to give feedback.
>>>>>> One suggested time for the hangout is next Friday 12 Dec. 17:30pm
>>>> (GMT+1).
>>>>>> I hope it is cross-atlantic friendly enough. Is that generally ok for
>>>> the
>>>>>> rest?
>>>>>>
>>>>>> Paris
>>>>>>
>>>>>> PS: thanks for the hilarious introduction of the windowing semantics
>>>>>> everyone :)
>>>>>>
>>>>>> ________________________________________
>>>>>> From: Kostas Tzoumas [[hidden email] <javascript:;>]
>>>>>> Sent: Sunday, December 07, 2014 1:23 PM
>>>>>> To: [hidden email] <javascript:;>
>>>>>> Subject: Re: Streaming windowing rework
>>>>>>
>>>>>> +1 great idea
>>>>>>
>>>>>> On Sun, Dec 7, 2014 at 10:35 AM, Gyula Fóra <[hidden email]
>>>>>> <javascript:;>> wrote:
>>>>>>
>>>>>>> Hey Henry,
>>>>>>>
>>>>>>> (I am resending this mail because it seems it didnt make it through the
>>>>>>> mail system)
>>>>>>>
>>>>>>> I suggest to have a public hangout sometimes on the current work we are
>>>>>>> doing and our plans on streaming.
>>>>>>>
>>>>>>> We have actually put together a list of topics that we want to work on
>>>>>> next
>>>>>>> year as we will have a quite large Flink team at SICS from January:
>>>>>> Paris,
>>>>>>> Jonas, Me and later Vasia.
>>>>>>>
>>>>>>> Basically the topics are:
>>>>>>> - Windowing semantics and multiquery optimisations (thats mainly Jonas'
>>>>>>> thesis topic)
>>>>>>> - Different fault tolerance approaches
>>>>>>> - Connecting batch and streaming api ('lambda')
>>>>>>> - Streaming graph algorithms
>>>>>>> - Samoa for Flink (and streaming machine learning in general)
>>>>>>>
>>>>>>> So lets start a series of public hangout calls to discuss these
>>>> topics, I
>>>>>>> would suggest one sometimes next week when it is suitable.
>>>>>>>
>>>>>>> Regards,
>>>>>>> Gyula
>>>>>>>
>>>>>>> On Sat, Dec 6, 2014 at 12:56 AM, Henry Saputra <
>>>> [hidden email]
>>>>>> <javascript:;>>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> We actually need to bring these work come to light early so we could
>>>>>>>> give feedback before getting to deep.
>>>>>>>>
>>>>>>>> Marton, could you encourage Paris and Jonas to publish or share their
>>>>>>>> thoughts about the work they are doing?
>>>>>>>>
>>>>>>>> Would love to give some feedbacks.
>>>>>>>>
>>>>>>>> - Henry
>>>>>>>>
>>>>>>>> On Fri, Dec 5, 2014 at 12:38 PM, Kostas Tzoumas <[hidden email]
>>>>>> <javascript:;>>
>>>>>>>> wrote:
>>>>>>>>> Super!
>>>>>>>>>
>>>>>>>>> Paris and Jonas have been doing a lot of "silent" work (= not very
>>>>>>>> visible
>>>>>>>>> in the mailing list) recently. Looking forward to seeing this coming
>>>>>>> in.
>>>>>>>>>
>>>>>>>>> On Fri, Dec 5, 2014 at 8:00 PM, Henry Saputra <
>>>>>> [hidden email] <javascript:;>
>>>>>>>>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Nice! Looking forward to it
>>>>>>>>>>
>>>>>>>>>> On Fri, Dec 5, 2014 at 9:34 AM, Márton Balassi <
>>>>>>>> [hidden email] <javascript:;>>
>>>>>>>>>> wrote:
>>>>>>>>>>> Hey,
>>>>>>>>>>>
>>>>>>>>>>> As you may know in some European countries Santa Claus comes on
>>>>>> the
>>>>>>>> 6th
>>>>>>>>>> of
>>>>>>>>>>> December, Saint Nicolas Day - from Finland.
>>>>>>>>>>>
>>>>>>>>>>> As Flink is not yet very active in Finland our Sweden team stepped
>>>>>>> in
>>>>>>>> and
>>>>>>>>>>> gave us a big present with a huge rework on the windowing
>>>>>> semantics
>>>>>>> -
>>>>>>>>>> this
>>>>>>>>>>> is the implementation of the ideas that were posed the Stockholm
>>>>>>>>>> hackathon
>>>>>>>>>>> in October.
>>>>>>>>>>>
>>>>>>>>>>> Big thanks to Jonas, Paris and Gyula. Jonas is posting a detailed
>>>>>>>> intro
>>>>>>>>>> to
>>>>>>>>>>> the new features here soon.
>>>>>>>>>>>
>>>>>>>>>>> Marton
>>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>>>
>>
>

[Gyula Fóra]

Hey all,

For tomorrow's hangout Paris wrote us a nice summary of our current plans
for the streaming api.

You can find it here:
https://docs.google.com/document/d/1qwhELe_sc3acULAC9bwRCTAcvmoriU5Cb727LWPOK0s/edit

It would be helpful if everyone could go through the points so it is easier
to discuss afterwards. Feel free to add any comments even before the
hangout.

We will post a hangout link too eventually :D

Cheers,
Gyula


On Mon, Dec 8, 2014 at 8:10 PM, Henry Saputra <[hidden email]>
wrote:

> HI Paris, this is great news!
>
> Thanks for the confirmation of time =)
>
> On Mon, Dec 8, 2014 at 3:22 AM, Paris Carbone <[hidden email]>
> wrote:
> > Hey,
> >
> > @Gyula I can help with the discussion content doc
> > @Gianmarco It will be great to have you! We will also keep you posted on
> the Samoa integration.
> > @Henry, correct, it’s 8:30am PST.
> >
> > cheers
> > Paris
> >
> >
> >> On 08 Dec 2014, at 11:34, Gyula Fora <[hidden email]> wrote:
> >>
> >> Hey,
> >>
> >> I’m glad that you want to join. We will post a hangout link here later
> :)
> >>
> >> Can someone please help me with setting these things up?
> >>
> >> Cheers,
> >> Gyula
> >>
> >>> On 08 Dec 2014, at 11:16, Gianmarco De Francisci Morales <
> [hidden email]> wrote:
> >>>
> >>> Hi,
> >>> I'm one of the developers of SAMOA and I'd be happy to participate as
> well.
> >>> How should I connect?
> >>>
> >>> Thanks,
> >>>
> >>>
> >>> --
> >>> Gianmarco
> >>>
> >>> On 8 December 2014 at 09:28, Asterios Katsifodimos <
> >>> [hidden email]> wrote:
> >>>
> >>>> Great work, +1 for Friday!
> >>>>
> >>>> Cheers,
> >>>> Asterios
> >>>>> On 08 Dec 2014, at 00:31, Henry Saputra <[hidden email]>
> wrote:
> >>>>>
> >>>>> Thanks Gyula,
> >>>>>
> >>>>> Just checking it will be 8:30am PST?
> >>>>>
> >>>>> To make it more productive please have some kind of simple design
> doc or
> >>>>> proposal with preso style to help us discuss each proposed work.
> >>>>>
> >>>>> Following the apache way, we then need to create Jira ticket and
> attach
> >>>> it
> >>>>> for other whom cannot attend the hangout to review and chime in.
> >>>>> Any Final decisions need to happen in dev list via emails or
> comments in
> >>>>> Jira.
> >>>>>
> >>>>> On Sunday, December 7, 2014, Paris Carbone <[hidden email]> wrote:
> >>>>>
> >>>>>> +1
> >>>>>>
> >>>>>> I agree it will be nice to discuss our upcoming directions and ideas
> >>>> with
> >>>>>> anyone that is interested to give feedback.
> >>>>>> One suggested time for the hangout is next Friday 12 Dec. 17:30pm
> >>>> (GMT+1).
> >>>>>> I hope it is cross-atlantic friendly enough. Is that generally ok
> for
> >>>> the
> >>>>>> rest?
> >>>>>>
> >>>>>> Paris
> >>>>>>
> >>>>>> PS: thanks for the hilarious introduction of the windowing semantics
> >>>>>> everyone :)
> >>>>>>
> >>>>>> ________________________________________
> >>>>>> From: Kostas Tzoumas [[hidden email] <javascript:;>]
> >>>>>> Sent: Sunday, December 07, 2014 1:23 PM
> >>>>>> To: [hidden email] <javascript:;>
> >>>>>> Subject: Re: Streaming windowing rework
> >>>>>>
> >>>>>> +1 great idea
> >>>>>>
> >>>>>> On Sun, Dec 7, 2014 at 10:35 AM, Gyula Fóra <[hidden email]
> >>>>>> <javascript:;>> wrote:
> >>>>>>
> >>>>>>> Hey Henry,
> >>>>>>>
> >>>>>>> (I am resending this mail because it seems it didnt make it
> through the
> >>>>>>> mail system)
> >>>>>>>
> >>>>>>> I suggest to have a public hangout sometimes on the current work
> we are
> >>>>>>> doing and our plans on streaming.
> >>>>>>>
> >>>>>>> We have actually put together a list of topics that we want to
> work on
> >>>>>> next
> >>>>>>> year as we will have a quite large Flink team at SICS from January:
> >>>>>> Paris,
> >>>>>>> Jonas, Me and later Vasia.
> >>>>>>>
> >>>>>>> Basically the topics are:
> >>>>>>> - Windowing semantics and multiquery optimisations (thats mainly
> Jonas'
> >>>>>>> thesis topic)
> >>>>>>> - Different fault tolerance approaches
> >>>>>>> - Connecting batch and streaming api ('lambda')
> >>>>>>> - Streaming graph algorithms
> >>>>>>> - Samoa for Flink (and streaming machine learning in general)
> >>>>>>>
> >>>>>>> So lets start a series of public hangout calls to discuss these
> >>>> topics, I
> >>>>>>> would suggest one sometimes next week when it is suitable.
> >>>>>>>
> >>>>>>> Regards,
> >>>>>>> Gyula
> >>>>>>>
> >>>>>>> On Sat, Dec 6, 2014 at 12:56 AM, Henry Saputra <
> >>>> [hidden email]
> >>>>>> <javascript:;>>
> >>>>>>> wrote:
> >>>>>>>
> >>>>>>>> We actually need to bring these work come to light early so we
> could
> >>>>>>>> give feedback before getting to deep.
> >>>>>>>>
> >>>>>>>> Marton, could you encourage Paris and Jonas to publish or share
> their
> >>>>>>>> thoughts about the work they are doing?
> >>>>>>>>
> >>>>>>>> Would love to give some feedbacks.
> >>>>>>>>
> >>>>>>>> - Henry
> >>>>>>>>
> >>>>>>>> On Fri, Dec 5, 2014 at 12:38 PM, Kostas Tzoumas <
> [hidden email]
> >>>>>> <javascript:;>>
> >>>>>>>> wrote:
> >>>>>>>>> Super!
> >>>>>>>>>
> >>>>>>>>> Paris and Jonas have been doing a lot of "silent" work (= not
> very
> >>>>>>>> visible
> >>>>>>>>> in the mailing list) recently. Looking forward to seeing this
> coming
> >>>>>>> in.
> >>>>>>>>>
> >>>>>>>>> On Fri, Dec 5, 2014 at 8:00 PM, Henry Saputra <
> >>>>>> [hidden email] <javascript:;>
> >>>>>>>>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> Nice! Looking forward to it
> >>>>>>>>>>
> >>>>>>>>>> On Fri, Dec 5, 2014 at 9:34 AM, Márton Balassi <
> >>>>>>>> [hidden email] <javascript:;>>
> >>>>>>>>>> wrote:
> >>>>>>>>>>> Hey,
> >>>>>>>>>>>
> >>>>>>>>>>> As you may know in some European countries Santa Claus comes on
> >>>>>> the
> >>>>>>>> 6th
> >>>>>>>>>> of
> >>>>>>>>>>> December, Saint Nicolas Day - from Finland.
> >>>>>>>>>>>
> >>>>>>>>>>> As Flink is not yet very active in Finland our Sweden team
> stepped
> >>>>>>> in
> >>>>>>>> and
> >>>>>>>>>>> gave us a big present with a huge rework on the windowing
> >>>>>> semantics
> >>>>>>> -
> >>>>>>>>>> this
> >>>>>>>>>>> is the implementation of the ideas that were posed the
> Stockholm
> >>>>>>>>>> hackathon
> >>>>>>>>>>> in October.
> >>>>>>>>>>>
> >>>>>>>>>>> Big thanks to Jonas, Paris and Gyula. Jonas is posting a
> detailed
> >>>>>>>> intro
> >>>>>>>>>> to
> >>>>>>>>>>> the new features here soon.
> >>>>>>>>>>>
> >>>>>>>>>>> Marton
> >>>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>
> >>>>
> >>
> >
>

[Robert Metzger]

Thank you Gyula. Can you past the document contents into our wiki?

On Thu, Dec 11, 2014 at 1:58 PM, Gyula Fóra <[hidden email]> wrote:

> Hey all,
>
> For tomorrow's hangout Paris wrote us a nice summary of our current plans
> for the streaming api.
>
> You can find it here:
>
> https://docs.google.com/document/d/1qwhELe_sc3acULAC9bwRCTAcvmoriU5Cb727LWPOK0s/edit
>
> It would be helpful if everyone could go through the points so it is easier
> to discuss afterwards. Feel free to add any comments even before the
> hangout.
>
> We will post a hangout link too eventually :D
>
> Cheers,
> Gyula
>
>
> On Mon, Dec 8, 2014 at 8:10 PM, Henry Saputra <[hidden email]>
> wrote:
>
> > HI Paris, this is great news!
> >
> > Thanks for the confirmation of time =)
> >
> > On Mon, Dec 8, 2014 at 3:22 AM, Paris Carbone <[hidden email]>
> > wrote:
> > > Hey,
> > >
> > > @Gyula I can help with the discussion content doc
> > > @Gianmarco It will be great to have you! We will also keep you posted
> on
> > the Samoa integration.
> > > @Henry, correct, it’s 8:30am PST.
> > >
> > > cheers
> > > Paris
> > >
> > >
> > >> On 08 Dec 2014, at 11:34, Gyula Fora <[hidden email]> wrote:
> > >>
> > >> Hey,
> > >>
> > >> I’m glad that you want to join. We will post a hangout link here later
> > :)
> > >>
> > >> Can someone please help me with setting these things up?
> > >>
> > >> Cheers,
> > >> Gyula
> > >>
> > >>> On 08 Dec 2014, at 11:16, Gianmarco De Francisci Morales <
> > [hidden email]> wrote:
> > >>>
> > >>> Hi,
> > >>> I'm one of the developers of SAMOA and I'd be happy to participate as
> > well.
> > >>> How should I connect?
> > >>>
> > >>> Thanks,
> > >>>
> > >>>
> > >>> --
> > >>> Gianmarco
> > >>>
> > >>> On 8 December 2014 at 09:28, Asterios Katsifodimos <
> > >>> [hidden email]> wrote:
> > >>>
> > >>>> Great work, +1 for Friday!
> > >>>>
> > >>>> Cheers,
> > >>>> Asterios
> > >>>>> On 08 Dec 2014, at 00:31, Henry Saputra <[hidden email]>
> > wrote:
> > >>>>>
> > >>>>> Thanks Gyula,
> > >>>>>
> > >>>>> Just checking it will be 8:30am PST?
> > >>>>>
> > >>>>> To make it more productive please have some kind of simple design
> > doc or
> > >>>>> proposal with preso style to help us discuss each proposed work.
> > >>>>>
> > >>>>> Following the apache way, we then need to create Jira ticket and
> > attach
> > >>>> it
> > >>>>> for other whom cannot attend the hangout to review and chime in.
> > >>>>> Any Final decisions need to happen in dev list via emails or
> > comments in
> > >>>>> Jira.
> > >>>>>
> > >>>>> On Sunday, December 7, 2014, Paris Carbone <[hidden email]> wrote:
> > >>>>>
> > >>>>>> +1
> > >>>>>>
> > >>>>>> I agree it will be nice to discuss our upcoming directions and
> ideas
> > >>>> with
> > >>>>>> anyone that is interested to give feedback.
> > >>>>>> One suggested time for the hangout is next Friday 12 Dec. 17:30pm
> > >>>> (GMT+1).
> > >>>>>> I hope it is cross-atlantic friendly enough. Is that generally ok
> > for
> > >>>> the
> > >>>>>> rest?
> > >>>>>>
> > >>>>>> Paris
> > >>>>>>
> > >>>>>> PS: thanks for the hilarious introduction of the windowing
> semantics
> > >>>>>> everyone :)
> > >>>>>>
> > >>>>>> ________________________________________
> > >>>>>> From: Kostas Tzoumas [[hidden email] <javascript:;>]
> > >>>>>> Sent: Sunday, December 07, 2014 1:23 PM
> > >>>>>> To: [hidden email] <javascript:;>
> > >>>>>> Subject: Re: Streaming windowing rework
> > >>>>>>
> > >>>>>> +1 great idea
> > >>>>>>
> > >>>>>> On Sun, Dec 7, 2014 at 10:35 AM, Gyula Fóra <[hidden email]
> > >>>>>> <javascript:;>> wrote:
> > >>>>>>
> > >>>>>>> Hey Henry,
> > >>>>>>>
> > >>>>>>> (I am resending this mail because it seems it didnt make it
> > through the
> > >>>>>>> mail system)
> > >>>>>>>
> > >>>>>>> I suggest to have a public hangout sometimes on the current work
> > we are
> > >>>>>>> doing and our plans on streaming.
> > >>>>>>>
> > >>>>>>> We have actually put together a list of topics that we want to
> > work on
> > >>>>>> next
> > >>>>>>> year as we will have a quite large Flink team at SICS from
> January:
> > >>>>>> Paris,
> > >>>>>>> Jonas, Me and later Vasia.
> > >>>>>>>
> > >>>>>>> Basically the topics are:
> > >>>>>>> - Windowing semantics and multiquery optimisations (thats mainly
> > Jonas'
> > >>>>>>> thesis topic)
> > >>>>>>> - Different fault tolerance approaches
> > >>>>>>> - Connecting batch and streaming api ('lambda')
> > >>>>>>> - Streaming graph algorithms
> > >>>>>>> - Samoa for Flink (and streaming machine learning in general)
> > >>>>>>>
> > >>>>>>> So lets start a series of public hangout calls to discuss these
> > >>>> topics, I
> > >>>>>>> would suggest one sometimes next week when it is suitable.
> > >>>>>>>
> > >>>>>>> Regards,
> > >>>>>>> Gyula
> > >>>>>>>
> > >>>>>>> On Sat, Dec 6, 2014 at 12:56 AM, Henry Saputra <
> > >>>> [hidden email]
> > >>>>>> <javascript:;>>
> > >>>>>>> wrote:
> > >>>>>>>
> > >>>>>>>> We actually need to bring these work come to light early so we
> > could
> > >>>>>>>> give feedback before getting to deep.
> > >>>>>>>>
> > >>>>>>>> Marton, could you encourage Paris and Jonas to publish or share
> > their
> > >>>>>>>> thoughts about the work they are doing?
> > >>>>>>>>
> > >>>>>>>> Would love to give some feedbacks.
> > >>>>>>>>
> > >>>>>>>> - Henry
> > >>>>>>>>
> > >>>>>>>> On Fri, Dec 5, 2014 at 12:38 PM, Kostas Tzoumas <
> > [hidden email]
> > >>>>>> <javascript:;>>
> > >>>>>>>> wrote:
> > >>>>>>>>> Super!
> > >>>>>>>>>
> > >>>>>>>>> Paris and Jonas have been doing a lot of "silent" work (= not
> > very
> > >>>>>>>> visible
> > >>>>>>>>> in the mailing list) recently. Looking forward to seeing this
> > coming
> > >>>>>>> in.
> > >>>>>>>>>
> > >>>>>>>>> On Fri, Dec 5, 2014 at 8:00 PM, Henry Saputra <
> > >>>>>> [hidden email] <javascript:;>
> > >>>>>>>>
> > >>>>>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> Nice! Looking forward to it
> > >>>>>>>>>>
> > >>>>>>>>>> On Fri, Dec 5, 2014 at 9:34 AM, Márton Balassi <
> > >>>>>>>> [hidden email] <javascript:;>>
> > >>>>>>>>>> wrote:
> > >>>>>>>>>>> Hey,
> > >>>>>>>>>>>
> > >>>>>>>>>>> As you may know in some European countries Santa Claus comes
> on
> > >>>>>> the
> > >>>>>>>> 6th
> > >>>>>>>>>> of
> > >>>>>>>>>>> December, Saint Nicolas Day - from Finland.
> > >>>>>>>>>>>
> > >>>>>>>>>>> As Flink is not yet very active in Finland our Sweden team
> > stepped
> > >>>>>>> in
> > >>>>>>>> and
> > >>>>>>>>>>> gave us a big present with a huge rework on the windowing
> > >>>>>> semantics
> > >>>>>>> -
> > >>>>>>>>>> this
> > >>>>>>>>>>> is the implementation of the ideas that were posed the
> > Stockholm
> > >>>>>>>>>> hackathon
> > >>>>>>>>>>> in October.
> > >>>>>>>>>>>
> > >>>>>>>>>>> Big thanks to Jonas, Paris and Gyula. Jonas is posting a
> > detailed
> > >>>>>>>> intro
> > >>>>>>>>>> to
> > >>>>>>>>>>> the new features here soon.
> > >>>>>>>>>>>
> > >>>>>>>>>>> Marton
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>>>>
> > >>>>>>
> > >>>>
> > >>>>
> > >>
> > >
> >
>

[Gyula Fóra]

Done :)

https://cwiki.apache.org/confluence/display/FLINK/Flink+Streaming <https://cwiki.apache.org/confluence/display/FLINK/Flink+Streaming>

Gyula

> On 11 Dec 2014, at 18:11, Robert Metzger <[hidden email]> wrote:
>
> Thank you Gyula. Can you past the document contents into our wiki?
>
> On Thu, Dec 11, 2014 at 1:58 PM, Gyula Fóra <[hidden email]> wrote:
>
>> Hey all,
>>
>> For tomorrow's hangout Paris wrote us a nice summary of our current plans
>> for the streaming api.
>>
>> You can find it here:
>>
>> https://docs.google.com/document/d/1qwhELe_sc3acULAC9bwRCTAcvmoriU5Cb727LWPOK0s/edit
>>
>> It would be helpful if everyone could go through the points so it is easier
>> to discuss afterwards. Feel free to add any comments even before the
>> hangout.
>>
>> We will post a hangout link too eventually :D
>>
>> Cheers,
>> Gyula
>>
>>
>> On Mon, Dec 8, 2014 at 8:10 PM, Henry Saputra <[hidden email]>
>> wrote:
>>
>>> HI Paris, this is great news!
>>>
>>> Thanks for the confirmation of time =)
>>>
>>> On Mon, Dec 8, 2014 at 3:22 AM, Paris Carbone <[hidden email]>
>>> wrote:
>>>> Hey,
>>>>
>>>> @Gyula I can help with the discussion content doc
>>>> @Gianmarco It will be great to have you! We will also keep you posted
>> on
>>> the Samoa integration.
>>>> @Henry, correct, it’s 8:30am PST.
>>>>
>>>> cheers
>>>> Paris
>>>>
>>>>
>>>>> On 08 Dec 2014, at 11:34, Gyula Fora <[hidden email]> wrote:
>>>>>
>>>>> Hey,
>>>>>
>>>>> I’m glad that you want to join. We will post a hangout link here later
>>> :)
>>>>>
>>>>> Can someone please help me with setting these things up?
>>>>>
>>>>> Cheers,
>>>>> Gyula
>>>>>
>>>>>> On 08 Dec 2014, at 11:16, Gianmarco De Francisci Morales <
>>> [hidden email]> wrote:
>>>>>>
>>>>>> Hi,
>>>>>> I'm one of the developers of SAMOA and I'd be happy to participate as
>>> well.
>>>>>> How should I connect?
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Gianmarco
>>>>>>
>>>>>> On 8 December 2014 at 09:28, Asterios Katsifodimos <
>>>>>> [hidden email]> wrote:
>>>>>>
>>>>>>> Great work, +1 for Friday!
>>>>>>>
>>>>>>> Cheers,
>>>>>>> Asterios
>>>>>>>> On 08 Dec 2014, at 00:31, Henry Saputra <[hidden email]>
>>> wrote:
>>>>>>>>
>>>>>>>> Thanks Gyula,
>>>>>>>>
>>>>>>>> Just checking it will be 8:30am PST?
>>>>>>>>
>>>>>>>> To make it more productive please have some kind of simple design
>>> doc or
>>>>>>>> proposal with preso style to help us discuss each proposed work.
>>>>>>>>
>>>>>>>> Following the apache way, we then need to create Jira ticket and
>>> attach
>>>>>>> it
>>>>>>>> for other whom cannot attend the hangout to review and chime in.
>>>>>>>> Any Final decisions need to happen in dev list via emails or
>>> comments in
>>>>>>>> Jira.
>>>>>>>>
>>>>>>>> On Sunday, December 7, 2014, Paris Carbone <[hidden email]> wrote:
>>>>>>>>
>>>>>>>>> +1
>>>>>>>>>
>>>>>>>>> I agree it will be nice to discuss our upcoming directions and
>> ideas
>>>>>>> with
>>>>>>>>> anyone that is interested to give feedback.
>>>>>>>>> One suggested time for the hangout is next Friday 12 Dec. 17:30pm
>>>>>>> (GMT+1).
>>>>>>>>> I hope it is cross-atlantic friendly enough. Is that generally ok
>>> for
>>>>>>> the
>>>>>>>>> rest?
>>>>>>>>>
>>>>>>>>> Paris
>>>>>>>>>
>>>>>>>>> PS: thanks for the hilarious introduction of the windowing
>> semantics
>>>>>>>>> everyone :)
>>>>>>>>>
>>>>>>>>> ________________________________________
>>>>>>>>> From: Kostas Tzoumas [[hidden email] <javascript:;>]
>>>>>>>>> Sent: Sunday, December 07, 2014 1:23 PM
>>>>>>>>> To: [hidden email] <javascript:;>
>>>>>>>>> Subject: Re: Streaming windowing rework
>>>>>>>>>
>>>>>>>>> +1 great idea
>>>>>>>>>
>>>>>>>>> On Sun, Dec 7, 2014 at 10:35 AM, Gyula Fóra <[hidden email]
>>>>>>>>> <javascript:;>> wrote:
>>>>>>>>>
>>>>>>>>>> Hey Henry,
>>>>>>>>>>
>>>>>>>>>> (I am resending this mail because it seems it didnt make it
>>> through the
>>>>>>>>>> mail system)
>>>>>>>>>>
>>>>>>>>>> I suggest to have a public hangout sometimes on the current work
>>> we are
>>>>>>>>>> doing and our plans on streaming.
>>>>>>>>>>
>>>>>>>>>> We have actually put together a list of topics that we want to
>>> work on
>>>>>>>>> next
>>>>>>>>>> year as we will have a quite large Flink team at SICS from
>> January:
>>>>>>>>> Paris,
>>>>>>>>>> Jonas, Me and later Vasia.
>>>>>>>>>>
>>>>>>>>>> Basically the topics are:
>>>>>>>>>> - Windowing semantics and multiquery optimisations (thats mainly
>>> Jonas'
>>>>>>>>>> thesis topic)
>>>>>>>>>> - Different fault tolerance approaches
>>>>>>>>>> - Connecting batch and streaming api ('lambda')
>>>>>>>>>> - Streaming graph algorithms
>>>>>>>>>> - Samoa for Flink (and streaming machine learning in general)
>>>>>>>>>>
>>>>>>>>>> So lets start a series of public hangout calls to discuss these
>>>>>>> topics, I
>>>>>>>>>> would suggest one sometimes next week when it is suitable.
>>>>>>>>>>
>>>>>>>>>> Regards,
>>>>>>>>>> Gyula
>>>>>>>>>>
>>>>>>>>>> On Sat, Dec 6, 2014 at 12:56 AM, Henry Saputra <
>>>>>>> [hidden email]
>>>>>>>>> <javascript:;>>
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> We actually need to bring these work come to light early so we
>>> could
>>>>>>>>>>> give feedback before getting to deep.
>>>>>>>>>>>
>>>>>>>>>>> Marton, could you encourage Paris and Jonas to publish or share
>>> their
>>>>>>>>>>> thoughts about the work they are doing?
>>>>>>>>>>>
>>>>>>>>>>> Would love to give some feedbacks.
>>>>>>>>>>>
>>>>>>>>>>> - Henry
>>>>>>>>>>>
>>>>>>>>>>> On Fri, Dec 5, 2014 at 12:38 PM, Kostas Tzoumas <
>>> [hidden email]
>>>>>>>>> <javascript:;>>
>>>>>>>>>>> wrote:
>>>>>>>>>>>> Super!
>>>>>>>>>>>>
>>>>>>>>>>>> Paris and Jonas have been doing a lot of "silent" work (= not
>>> very
>>>>>>>>>>> visible
>>>>>>>>>>>> in the mailing list) recently. Looking forward to seeing this
>>> coming
>>>>>>>>>> in.
>>>>>>>>>>>>
>>>>>>>>>>>> On Fri, Dec 5, 2014 at 8:00 PM, Henry Saputra <
>>>>>>>>> [hidden email] <javascript:;>
>>>>>>>>>>>
>>>>>>>>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Nice! Looking forward to it
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Fri, Dec 5, 2014 at 9:34 AM, Márton Balassi <
>>>>>>>>>>> [hidden email] <javascript:;>>
>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>> Hey,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> As you may know in some European countries Santa Claus comes
>> on
>>>>>>>>> the
>>>>>>>>>>> 6th
>>>>>>>>>>>>> of
>>>>>>>>>>>>>> December, Saint Nicolas Day - from Finland.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> As Flink is not yet very active in Finland our Sweden team
>>> stepped
>>>>>>>>>> in
>>>>>>>>>>> and
>>>>>>>>>>>>>> gave us a big present with a huge rework on the windowing
>>>>>>>>> semantics
>>>>>>>>>> -
>>>>>>>>>>>>> this
>>>>>>>>>>>>>> is the implementation of the ideas that were posed the
>>> Stockholm
>>>>>>>>>>>>> hackathon
>>>>>>>>>>>>>> in October.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Big thanks to Jonas, Paris and Gyula. Jonas is posting a
>>> detailed
>>>>>>>>>>> intro
>>>>>>>>>>>>> to
>>>>>>>>>>>>>> the new features here soon.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Marton
>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>
>>>>
>>>
>>