cancel running stream job

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

cancel running stream job

nse sik
Hi guys,

I'm trying to connect flink streaming and zeppelin,
however if I try to resubmit a streaming program from zeppelin I receive a
"org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException".

Is there a way to cancel a running Streaming Job ?
And would cancelling the Streaming Job in this case free up resources for
resubmission?

best,
Nikolaas
Reply | Threaded
Open this post in threaded view
|

Re: cancel running stream job

Ufuk Celebi-2
Yes, you can cancel it via the web frontend or the CLI interface [1].

If you can send messages to the JobManager, you can also send a
CancelJob message yourself.

[1] https://ci.apache.org/projects/flink/flink-docs-master/apis/cli.html

On Fri, Feb 19, 2016 at 12:08 PM, Nikolaas s
<[hidden email]> wrote:

> Hi guys,
>
> I'm trying to connect flink streaming and zeppelin,
> however if I try to resubmit a streaming program from zeppelin I receive a
> "org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException".
>
> Is there a way to cancel a running Streaming Job ?
> And would cancelling the Streaming Job in this case free up resources for
> resubmission?
>
> best,
> Nikolaas
Reply | Threaded
Open this post in threaded view
|

Re: cancel running stream job

Márton Balassi
Adding to Ufuk's answer: yes, cancelling the job frees up the resources. :)

Best:

Marton

On Fri, Feb 19, 2016 at 12:10 PM, Ufuk Celebi <[hidden email]> wrote:

> Yes, you can cancel it via the web frontend or the CLI interface [1].
>
> If you can send messages to the JobManager, you can also send a
> CancelJob message yourself.
>
> [1] https://ci.apache.org/projects/flink/flink-docs-master/apis/cli.html
>
> On Fri, Feb 19, 2016 at 12:08 PM, Nikolaas s
> <[hidden email]> wrote:
> > Hi guys,
> >
> > I'm trying to connect flink streaming and zeppelin,
> > however if I try to resubmit a streaming program from zeppelin I receive
> a
> >
> "org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException".
> >
> > Is there a way to cancel a running Streaming Job ?
> > And would cancelling the Streaming Job in this case free up resources for
> > resubmission?
> >
> > best,
> > Nikolaas
>
Reply | Threaded
Open this post in threaded view
|

Re: cancel running stream job

Till Rohrmann
Furthermore, if all of your sources are stoppable, then you can even stop
the streaming job gracefully now either using the CLI or the StopJob
message.

Cheers,
Till


On Fri, Feb 19, 2016 at 12:16 PM, Márton Balassi <[hidden email]>
wrote:

> Adding to Ufuk's answer: yes, cancelling the job frees up the resources. :)
>
> Best:
>
> Marton
>
> On Fri, Feb 19, 2016 at 12:10 PM, Ufuk Celebi <[hidden email]> wrote:
>
> > Yes, you can cancel it via the web frontend or the CLI interface [1].
> >
> > If you can send messages to the JobManager, you can also send a
> > CancelJob message yourself.
> >
> > [1] https://ci.apache.org/projects/flink/flink-docs-master/apis/cli.html
> >
> > On Fri, Feb 19, 2016 at 12:08 PM, Nikolaas s
> > <[hidden email]> wrote:
> > > Hi guys,
> > >
> > > I'm trying to connect flink streaming and zeppelin,
> > > however if I try to resubmit a streaming program from zeppelin I
> receive
> > a
> > >
> >
> "org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException".
> > >
> > > Is there a way to cancel a running Streaming Job ?
> > > And would cancelling the Streaming Job in this case free up resources
> for
> > > resubmission?
> > >
> > > best,
> > > Nikolaas
> >
>