Make Streaming Interoperable with Reactive Streams, Java Streams and Rx

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Make Streaming Interoperable with Reactive Streams, Java Streams and Rx

sirinath
Hi,

Is it possible to add interop with the following projects in Streaming:
 - http://reactive-streams.org/ specification
 - Java Streams
 - If possible http://reactivex.io/

Suminda
Reply | Threaded
Open this post in threaded view
|

Re: Make Streaming Interoperable with Reactive Streams, Java Streams and Rx

Gyula Fóra-2
Hey Suminda,

I am not 100% by what you mean by interoperating, so clarify me if I am off-track here :)

The systems that you have mentioned provide programming models for stream processing systems, in that sense a lot of features of Flink runtime are similar to these systems but it is presented in a much higher level API.

If by interoperating you mean connecting the streams from one systems to another, it is definitely possible in fact would be probably quite easy. For example a source in the Flink streaming system would implement a consumer in the other system and could receive messages and process them. On the other and a Flink sink could be implemented as a Producer for the other systems.

I hope this answers your questions, if not, let me know :)

Gyula

> On 06 Nov 2014, at 19:09, sirinath <[hidden email]> wrote:
>
> Hi,
>
> Is it possible to add interop with the following projects in Streaming:
> - http://reactive-streams.org/ specification
> - Java Streams
> - If possible http://reactivex.io/
>
> Suminda
>
>
>
>
> --
> View this message in context: http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/Make-Streaming-Interoperable-with-Reactive-Streams-Java-Streams-and-Rx-tp2392.html
> Sent from the Apache Flink (Incubator) Mailing List archive. mailing list archive at Nabble.com.

Reply | Threaded
Open this post in threaded view
|

Re: Make Streaming Interoperable with Reactive Streams, Java Streams and Rx

sirinath
What I ment was to have stream connectors for Java Streams, Rx (http://reactivex.io/), Reactive Streams (reactive-streams.org), JCTools (https://github.com/JCTools/JCTools), Chronicles (https://github.com/OpenHFT), Vertex (http://vertx.io/), Vertigo (https://github.com/kuujo/vertigo), Akka, Quasar (https://github.com/puniverse/quasar), GPars, etc. out of the box. This will be a good selling point without too much effort on part of you core team.
Reply | Threaded
Open this post in threaded view
|

Re: Make Streaming Interoperable with Reactive Streams, Java Streams and Rx

Gyula Fóra-2
Thank you for your suggestions. We are planning to extend connector support to many other systems.
In the meantime, any contribution regarding this is warmly welcome.

> On 07 Nov 2014, at 07:02, sirinath <[hidden email]> wrote:
>
> What I ment was to have stream connectors for Java Streams, Rx
> (http://reactivex.io/), Reactive Streams (reactive-streams.org), JCTools
> (https://github.com/JCTools/JCTools), Chronicles
> (https://github.com/OpenHFT), Vertex (http://vertx.io/), Vertigo
> (https://github.com/kuujo/vertigo), Akka, Quasar
> (https://github.com/puniverse/quasar), GPars, etc. out of the box. This will
> be a good selling point without too much effort on part of you core team.
>
>
>
> --
> View this message in context: http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/Make-Streaming-Interoperable-with-Reactive-Streams-Java-Streams-and-Rx-tp2392p2394.html
> Sent from the Apache Flink (Incubator) Mailing List archive. mailing list archive at Nabble.com.