YARN/Flink Job

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

YARN/Flink Job

Vijay Srinivasaraghavan
If I start a flink job on YARN with below option, does Flink (JM & TM) service gets killed after the job execution is complete? In otherwords, what is the lifetime of the Flink service after the job is complete?  

Run a single Flink job on YARN
The documentation above describes how to start a Flink cluster within a Hadoop YARN environment. It is also possible to launch Flink within YARN only for executing a single job.Please note that the client then expects the -yn value to be set (number of TaskManagers).Example:./bin/flink run -m yarn-cluster -yn 2 ./examples/batch/WordCount.jar
RegardsVijay
Reply | Threaded
Open this post in threaded view
|

Re: YARN/Flink Job

Chiwan Park-2
Hi Vijay,

Yes, you are right. Flink services (JM & TM) are stopped (not killed) immediately after the job execution.

Regards,
Chiwan Park

> On Mar 18, 2016, at 7:57 AM, Vijay Srinivasaraghavan <[hidden email]> wrote:
>
> If I start a flink job on YARN with below option, does Flink (JM & TM) service gets killed after the job execution is complete? In otherwords, what is the lifetime of the Flink service after the job is complete?  
>
> Run a single Flink job on YARN
> The documentation above describes how to start a Flink cluster within a Hadoop YARN environment. It is also possible to launch Flink within YARN only for executing a single job.Please note that the client then expects the -yn value to be set (number of TaskManagers).Example:./bin/flink run -m yarn-cluster -yn 2 ./examples/batch/WordCount.jar
> RegardsVijay