Question: RemoteStreamEnvironment submit in detach mode.

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Question: RemoteStreamEnvironment submit in detach mode.

Liangfei Su
Hi,

I get a question when try to submit a graph to a remote stream
RemoteStreamEnvironment in detach mode.

From the client API, it looks when use call execute().  User doesn't have a
way to control whether run in detach mode or not. Since it's
the RemoteStreamEnvironment create a StandaloneClusterClient and flag
detachedJobSubmission is never get chance to be configured?

Is there any doc on this? I did try but didn't find in doc, or wiki yet...

Thanks
Ralph
Reply | Threaded
Open this post in threaded view
|

RE: Question: RemoteStreamEnvironment submit in detach mode.

Evgeny Kincharov
Hi, Ralph.

You are right, there is only one way to run streaming job at the current version 1.2 and it is blocking the main thread.
We have some open issues connected with this [1], [2], and the open PR related this topic [3]. You may look for details there.

Thanks for your interest in this topic.

BR, Evgeny

[1] - https://issues.apache.org/jira/browse/FLINK-2313 
[2] - https://issues.apache.org/jira/browse/FLINK-4272 
[3] - https://github.com/apache/flink/pull/2732 

-----Original Message-----
From: Liangfei Su [mailto:[hidden email]]
Sent: Wednesday, March 15, 2017 11:19 AM
To: [hidden email]
Subject: Question: RemoteStreamEnvironment submit in detach mode.

Hi,

I get a question when try to submit a graph to a remote stream
RemoteStreamEnvironment in detach mode.

From the client API, it looks when use call execute().  User doesn't have a
way to control whether run in detach mode or not. Since it's
the RemoteStreamEnvironment create a StandaloneClusterClient and flag
detachedJobSubmission is never get chance to be configured?

Is there any doc on this? I did try but didn't find in doc, or wiki yet...

Thanks
Ralph
Reply | Threaded
Open this post in threaded view
|

Re: Question: RemoteStreamEnvironment submit in detach mode.

Liangfei Su
Thanks for the information, Evgeny.

It looks no fixed version for these feature which i think it quite common
requirement. Do we have any planned release to include this fix?

Thanks
Ralph



On Wed, Mar 15, 2017 at 3:49 PM, Evgeny Kincharov <[hidden email]
> wrote:

> Hi, Ralph.
>
> You are right, there is only one way to run streaming job at the current
> version 1.2 and it is blocking the main thread.
> We have some open issues connected with this [1], [2], and the open PR
> related this topic [3]. You may look for details there.
>
> Thanks for your interest in this topic.
>
> BR, Evgeny
>
> [1] - https://issues.apache.org/jira/browse/FLINK-2313
> [2] - https://issues.apache.org/jira/browse/FLINK-4272
> [3] - https://github.com/apache/flink/pull/2732
>
> -----Original Message-----
> From: Liangfei Su [mailto:[hidden email]]
> Sent: Wednesday, March 15, 2017 11:19 AM
> To: [hidden email]
> Subject: Question: RemoteStreamEnvironment submit in detach mode.
>
> Hi,
>
> I get a question when try to submit a graph to a remote stream
> RemoteStreamEnvironment in detach mode.
>
> From the client API, it looks when use call execute().  User doesn't have a
> way to control whether run in detach mode or not. Since it's
> the RemoteStreamEnvironment create a StandaloneClusterClient and flag
> detachedJobSubmission is never get chance to be configured?
>
> Is there any doc on this? I did try but didn't find in doc, or wiki yet...
>
> Thanks
> Ralph
>
Reply | Threaded
Open this post in threaded view
|

Re: Question: RemoteStreamEnvironment submit in detach mode.

Aljoscha Krettek-2
I would also really like to have this feature in. I'll try and see if I
can find some time to get the PR into mergeable shape.

On Wed, Mar 15, 2017, at 09:11, Liangfei Su wrote:

> Thanks for the information, Evgeny.
>
> It looks no fixed version for these feature which i think it quite common
> requirement. Do we have any planned release to include this fix?
>
> Thanks
> Ralph
>
>
>
> On Wed, Mar 15, 2017 at 3:49 PM, Evgeny Kincharov
> <[hidden email]
> > wrote:
>
> > Hi, Ralph.
> >
> > You are right, there is only one way to run streaming job at the current
> > version 1.2 and it is blocking the main thread.
> > We have some open issues connected with this [1], [2], and the open PR
> > related this topic [3]. You may look for details there.
> >
> > Thanks for your interest in this topic.
> >
> > BR, Evgeny
> >
> > [1] - https://issues.apache.org/jira/browse/FLINK-2313
> > [2] - https://issues.apache.org/jira/browse/FLINK-4272
> > [3] - https://github.com/apache/flink/pull/2732
> >
> > -----Original Message-----
> > From: Liangfei Su [mailto:[hidden email]]
> > Sent: Wednesday, March 15, 2017 11:19 AM
> > To: [hidden email]
> > Subject: Question: RemoteStreamEnvironment submit in detach mode.
> >
> > Hi,
> >
> > I get a question when try to submit a graph to a remote stream
> > RemoteStreamEnvironment in detach mode.
> >
> > From the client API, it looks when use call execute().  User doesn't have a
> > way to control whether run in detach mode or not. Since it's
> > the RemoteStreamEnvironment create a StandaloneClusterClient and flag
> > detachedJobSubmission is never get chance to be configured?
> >
> > Is there any doc on this? I did try but didn't find in doc, or wiki yet...
> >
> > Thanks
> > Ralph
> >