Regarding `flink-streaming` project dependencies

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Regarding `flink-streaming` project dependencies

Liwei Lin
Hi folks,

There are comments like this in
`StreamExecutionEnvironment.getExecutionEnvironment()`:

// because the streaming project depends on "flink-clients" (and not the
> other way around)
> // we currently need to intercept the data set environment and create a
> dependent stream env.
> // this should be fixed once we rework the project dependencies


https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/environment/StreamExecutionEnvironment.java#L1592-L1594

I wonder if there is any plan to rework the project dependencies? In the
long run, are we planning to have `flink-clients` depend on
`flink-streaming` or to have `flink-java` depend on `flink-clients`?

Thanks!

Liwei
Reply | Threaded
Open this post in threaded view
|

Re: Regarding `flink-streaming` project dependencies

Stephan Ewen
Hi!

Yes, there are definitely plans and desires to do that, definitely. May be
breaking some API / dependency structure, so probably a candidate for Flink
2.0

Greetings,
Stephan


On Tue, Sep 27, 2016 at 10:45 AM, Liwei Lin <[hidden email]> wrote:

> Hi folks,
>
> There are comments like this in
> `StreamExecutionEnvironment.getExecutionEnvironment()`:
>
> // because the streaming project depends on "flink-clients" (and not the
> > other way around)
> > // we currently need to intercept the data set environment and create a
> > dependent stream env.
> > // this should be fixed once we rework the project dependencies
>
>
> https://github.com/apache/flink/blob/master/flink-
> streaming-java/src/main/java/org/apache/flink/streaming/api/environment/
> StreamExecutionEnvironment.java#L1592-L1594
>
> I wonder if there is any plan to rework the project dependencies? In the
> long run, are we planning to have `flink-clients` depend on
> `flink-streaming` or to have `flink-java` depend on `flink-clients`?
>
> Thanks!
>
> Liwei
>
Reply | Threaded
Open this post in threaded view
|

Re: Regarding `flink-streaming` project dependencies

Liwei Lin
Thanks Stephan for the prompt response!

Glad to know it's targeted for Flink 2.0. Is there any JIRA tracking this?
I couldn't find such one, :-)

Thanks!

Liwei


On Tue, Sep 27, 2016 at 4:47 PM, Stephan Ewen <[hidden email]> wrote:

> Hi!
>
> Yes, there are definitely plans and desires to do that, definitely. May be
> breaking some API / dependency structure, so probably a candidate for Flink
> 2.0
>
> Greetings,
> Stephan
>
>
> On Tue, Sep 27, 2016 at 10:45 AM, Liwei Lin <[hidden email]> wrote:
>
> > Hi folks,
> >
> > There are comments like this in
> > `StreamExecutionEnvironment.getExecutionEnvironment()`:
> >
> > // because the streaming project depends on "flink-clients" (and not the
> > > other way around)
> > > // we currently need to intercept the data set environment and create a
> > > dependent stream env.
> > > // this should be fixed once we rework the project dependencies
> >
> >
> > https://github.com/apache/flink/blob/master/flink-
> > streaming-java/src/main/java/org/apache/flink/streaming/api/environment/
> > StreamExecutionEnvironment.java#L1592-L1594
> >
> > I wonder if there is any plan to rework the project dependencies? In the
> > long run, are we planning to have `flink-clients` depend on
> > `flink-streaming` or to have `flink-java` depend on `flink-clients`?
> >
> > Thanks!
> >
> > Liwei
> >
>
mxm
Reply | Threaded
Open this post in threaded view
|

Re: Regarding `flink-streaming` project dependencies

mxm
Hi Liwei,

I created this a while ago which is pretty much what you want as well:
https://issues.apache.org/jira/browse/FLINK-3276

Cheers,
Max

On Tue, Sep 27, 2016 at 11:09 AM, Liwei Lin <[hidden email]> wrote:

> Thanks Stephan for the prompt response!
>
> Glad to know it's targeted for Flink 2.0. Is there any JIRA tracking this?
> I couldn't find such one, :-)
>
> Thanks!
>
> Liwei
>
>
> On Tue, Sep 27, 2016 at 4:47 PM, Stephan Ewen <[hidden email]> wrote:
>
>> Hi!
>>
>> Yes, there are definitely plans and desires to do that, definitely. May be
>> breaking some API / dependency structure, so probably a candidate for Flink
>> 2.0
>>
>> Greetings,
>> Stephan
>>
>>
>> On Tue, Sep 27, 2016 at 10:45 AM, Liwei Lin <[hidden email]> wrote:
>>
>> > Hi folks,
>> >
>> > There are comments like this in
>> > `StreamExecutionEnvironment.getExecutionEnvironment()`:
>> >
>> > // because the streaming project depends on "flink-clients" (and not the
>> > > other way around)
>> > > // we currently need to intercept the data set environment and create a
>> > > dependent stream env.
>> > > // this should be fixed once we rework the project dependencies
>> >
>> >
>> > https://github.com/apache/flink/blob/master/flink-
>> > streaming-java/src/main/java/org/apache/flink/streaming/api/environment/
>> > StreamExecutionEnvironment.java#L1592-L1594
>> >
>> > I wonder if there is any plan to rework the project dependencies? In the
>> > long run, are we planning to have `flink-clients` depend on
>> > `flink-streaming` or to have `flink-java` depend on `flink-clients`?
>> >
>> > Thanks!
>> >
>> > Liwei
>> >
>>
Reply | Threaded
Open this post in threaded view
|

Re: Regarding `flink-streaming` project dependencies

Liwei Lin
Thank you Max for the pointer! I've started watching it, :-D

Cheers,
Liwei

On Wed, Sep 28, 2016 at 9:45 PM, Maximilian Michels <[hidden email]> wrote:

> Hi Liwei,
>
> I created this a while ago which is pretty much what you want as well:
> https://issues.apache.org/jira/browse/FLINK-3276
>
> Cheers,
> Max
>
> On Tue, Sep 27, 2016 at 11:09 AM, Liwei Lin <[hidden email]> wrote:
> > Thanks Stephan for the prompt response!
> >
> > Glad to know it's targeted for Flink 2.0. Is there any JIRA tracking
> this?
> > I couldn't find such one, :-)
> >
> > Thanks!
> >
> > Liwei
> >
> >
> > On Tue, Sep 27, 2016 at 4:47 PM, Stephan Ewen <[hidden email]> wrote:
> >
> >> Hi!
> >>
> >> Yes, there are definitely plans and desires to do that, definitely. May
> be
> >> breaking some API / dependency structure, so probably a candidate for
> Flink
> >> 2.0
> >>
> >> Greetings,
> >> Stephan
> >>
> >>
> >> On Tue, Sep 27, 2016 at 10:45 AM, Liwei Lin <[hidden email]> wrote:
> >>
> >> > Hi folks,
> >> >
> >> > There are comments like this in
> >> > `StreamExecutionEnvironment.getExecutionEnvironment()`:
> >> >
> >> > // because the streaming project depends on "flink-clients" (and not
> the
> >> > > other way around)
> >> > > // we currently need to intercept the data set environment and
> create a
> >> > > dependent stream env.
> >> > > // this should be fixed once we rework the project dependencies
> >> >
> >> >
> >> > https://github.com/apache/flink/blob/master/flink-
> >> > streaming-java/src/main/java/org/apache/flink/streaming/
> api/environment/
> >> > StreamExecutionEnvironment.java#L1592-L1594
> >> >
> >> > I wonder if there is any plan to rework the project dependencies? In
> the
> >> > long run, are we planning to have `flink-clients` depend on
> >> > `flink-streaming` or to have `flink-java` depend on `flink-clients`?
> >> >
> >> > Thanks!
> >> >
> >> > Liwei
> >> >
> >>
>