A documentation for streaming

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

A documentation for streaming

Márton Balassi
Hey,

As requested in the FLINK-1058 JIRA ticket we've started to put together a
documentation for streaming. You can find it here:
https://github.com/mbalassi/incubator-flink/blob/documentation/docs/streaming_guide.md

I've also built it:
http://info.ilab.sztaki.hu/~mbalassi/flink-streaming/streaming_guide.html

We are still working on the part on connectors and adding a section on
aggregations soon.

Any comments are welcome.

Cheers,

The streaming team
Reply | Threaded
Open this post in threaded view
|

Re: A documentation for streaming

Kostas Tzoumas-2
Looks awesome!

It would also be great to have one non-trivial piece of example code in the
docs that connects to a streaming source, does some transformations, and
prints the output to a file (or forwards to a streaming sink). I think this
is a common use case that people have in mind, so showing that early would
make their lives easier.


On Thu, Sep 4, 2014 at 9:03 PM, Márton Balassi <[hidden email]>
wrote:

> Hey,
>
> As requested in the FLINK-1058 JIRA ticket we've started to put together a
> documentation for streaming. You can find it here:
>
> https://github.com/mbalassi/incubator-flink/blob/documentation/docs/streaming_guide.md
>
> I've also built it:
> http://info.ilab.sztaki.hu/~mbalassi/flink-streaming/streaming_guide.html
>
> We are still working on the part on connectors and adding a section on
> aggregations soon.
>
> Any comments are welcome.
>
> Cheers,
>
> The streaming team
>
Reply | Threaded
Open this post in threaded view
|

Re: A documentation for streaming

Márton Balassi
Thanks.

We're adding a join type example with some filtering, aggregating a value
over a window then. Some extended version of this:
https://github.com/mbalassi/incubator-flink/tree/streaming-new/flink-addons/flink-streaming/flink-streaming-examples/src/main/java/org/apache/flink/streaming/examples/window/join

We're also also adding an example where the source gets messages from the
Twitter Streaming API - which needs a bit of setup, but might be
interesting for some users.


On Fri, Sep 5, 2014 at 8:54 AM, Kostas Tzoumas <[hidden email]> wrote:

> Looks awesome!
>
> It would also be great to have one non-trivial piece of example code in the
> docs that connects to a streaming source, does some transformations, and
> prints the output to a file (or forwards to a streaming sink). I think this
> is a common use case that people have in mind, so showing that early would
> make their lives easier.
>
>
> On Thu, Sep 4, 2014 at 9:03 PM, Márton Balassi <[hidden email]>
> wrote:
>
> > Hey,
> >
> > As requested in the FLINK-1058 JIRA ticket we've started to put together
> a
> > documentation for streaming. You can find it here:
> >
> >
> https://github.com/mbalassi/incubator-flink/blob/documentation/docs/streaming_guide.md
> >
> > I've also built it:
> >
> http://info.ilab.sztaki.hu/~mbalassi/flink-streaming/streaming_guide.html
> >
> > We are still working on the part on connectors and adding a section on
> > aggregations soon.
> >
> > Any comments are welcome.
> >
> > Cheers,
> >
> > The streaming team
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: A documentation for streaming

Henry Saputra
In reply to this post by Márton Balassi
Hi @Márton,

This is a great start.

I am recommend to merge this now and do iterative development on top
of it for improvement.

- Henry

On Thu, Sep 4, 2014 at 12:03 PM, Márton Balassi
<[hidden email]> wrote:

> Hey,
>
> As requested in the FLINK-1058 JIRA ticket we've started to put together a
> documentation for streaming. You can find it here:
> https://github.com/mbalassi/incubator-flink/blob/documentation/docs/streaming_guide.md
>
> I've also built it:
> http://info.ilab.sztaki.hu/~mbalassi/flink-streaming/streaming_guide.html
>
> We are still working on the part on connectors and adding a section on
> aggregations soon.
>
> Any comments are welcome.
>
> Cheers,
>
> The streaming team