Adding the streaming project to the main repository

[Márton Balassi]

My username is mbalassi.
I've started watching the issue to give you a link. :)


On Tue, Aug 19, 2014 at 8:07 AM, Henry Saputra <[hidden email]>
wrote:

> Hi Marton,
>
> I created the JIRA ticket to track the streaming documentation:
> https://issues.apache.org/jira/browse/FLINK-1058
> Somehow I could not find your ASF JIRA username. Could you tell me
> what is your ASF JIRA username?
>
> - Henry
>
> On Mon, Aug 18, 2014 at 10:29 PM, Márton Balassi
> <[hidden email]> wrote:
> > Sure, please assign it to me.
> >
> > On Aug 19, 2014 2:44 AM, "Henry Saputra" <[hidden email]>
> wrote:
> >
> >> Thanks Stephan. If no one object I will create JIRA ticket as reminder
> >> to add formal documentation for the streaming feature.
> >>
> >> - Henry
> >>
> >> On Mon, Aug 18, 2014 at 11:53 AM, Stephan Ewen <[hidden email]>
> wrote:
> >> > The streaming code is in "flink-addons", for new/experimental code.
> >> >
> >> > Documents should come over the next days/weeks, definitely before we
> make
> >> > this part of the core.
> >> >
> >> > Right now, I would suggest to have a look at some of the examples, to
> >> get a
> >> > feeling for the addon, check for example this here:
> >> >
> >>
> https://github.com/apache/incubator-flink/tree/master/flink-addons/flink-streaming/flink-streaming-examples/src/main/java/org/apache/flink/streaming/examples/wordcount
> >> >
> >> > (The example reads a file for simplicity, but the project also
> provides
> >> > connectors for Kafka, RabbitMQ, ...)
> >>
>

[Henry Saputra]

Thanks, I just assign you the issue =)

- Henry

On Mon, Aug 18, 2014 at 11:38 PM, Márton Balassi
<[hidden email]> wrote:

> My username is mbalassi.
> I've started watching the issue to give you a link. :)
>
>
> On Tue, Aug 19, 2014 at 8:07 AM, Henry Saputra <[hidden email]>
> wrote:
>
>> Hi Marton,
>>
>> I created the JIRA ticket to track the streaming documentation:
>> https://issues.apache.org/jira/browse/FLINK-1058
>> Somehow I could not find your ASF JIRA username. Could you tell me
>> what is your ASF JIRA username?
>>
>> - Henry
>>
>> On Mon, Aug 18, 2014 at 10:29 PM, Márton Balassi
>> <[hidden email]> wrote:
>> > Sure, please assign it to me.
>> >
>> > On Aug 19, 2014 2:44 AM, "Henry Saputra" <[hidden email]>
>> wrote:
>> >
>> >> Thanks Stephan. If no one object I will create JIRA ticket as reminder
>> >> to add formal documentation for the streaming feature.
>> >>
>> >> - Henry
>> >>
>> >> On Mon, Aug 18, 2014 at 11:53 AM, Stephan Ewen <[hidden email]>
>> wrote:
>> >> > The streaming code is in "flink-addons", for new/experimental code.
>> >> >
>> >> > Documents should come over the next days/weeks, definitely before we
>> make
>> >> > this part of the core.
>> >> >
>> >> > Right now, I would suggest to have a look at some of the examples, to
>> >> get a
>> >> > feeling for the addon, check for example this here:
>> >> >
>> >>
>> https://github.com/apache/incubator-flink/tree/master/flink-addons/flink-streaming/flink-streaming-examples/src/main/java/org/apache/flink/streaming/examples/wordcount
>> >> >
>> >> > (The example reads a file for simplicity, but the project also
>> provides
>> >> > connectors for Kafka, RabbitMQ, ...)
>> >>
>>

[Fabian Hueske]

Thanks for the explanation!
Very nice set of features. Looking forward to check it out myself :-)


2014-08-18 21:38 GMT+02:00 Gyula Fóra <[hidden email]>:

> Hey,
>
> The simple reduce is like what you said yes. But there are also grouped
> reduce which you can use by calling .groupBy(keyposition) and then reduce.
>
> Also there is reduce for windows: batchReduce and windowReduce batch gives
> you a sliding window over a predefined number of records, and window reduce
> gices you the same but by time. (also there are grouped versions of these)
>
> Cheers,
> Gyula
>
>
> On Mon, Aug 18, 2014 at 9:19 PM, Fabian Hueske <[hidden email]> wrote:
>
> > Hi folks,
> >
> > great work!
> >
> > Looking at the example I have a quick question. What's the semantics of
> the
> > Reduce operator? I guess its not a window reduce.
> > Is it backed by a hash table and every input tuple updates the hash table
> > and returns the updated value?
> >
> > Cheers, Fabian
> >
> >
> > 2014-08-18 20:53 GMT+02:00 Stephan Ewen <[hidden email]>:
> >
> > > The streaming code is in "flink-addons", for new/experimental code.
> > >
> > > Documents should come over the next days/weeks, definitely before we
> make
> > > this part of the core.
> > >
> > > Right now, I would suggest to have a look at some of the examples, to
> > get a
> > > feeling for the addon, check for example this here:
> > >
> > >
> >
> https://github.com/apache/incubator-flink/tree/master/flink-addons/flink-streaming/flink-streaming-examples/src/main/java/org/apache/flink/streaming/examples/wordcount
> > >
> > > (The example reads a file for simplicity, but the project also provides
> > > connectors for Kafka, RabbitMQ, ...)
> > >
> >
>