FailureRate Restart Strategy is not picked from Config file

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

FailureRate Restart Strategy is not picked from Config file

Deepak Jha
Hi All,
I tried to use FailureRate restart strategy by setting values for it in flink-conf.yaml but flink (v 1.1.2) did not pick it up.

# Flink Restart strategy
restart-strategy: failure-rate
restart-strategy.failure-rate.delay: 120 s
restart-strategy.failure-rate.failure-rate-interval: 12 minute
restart-strategy.failure-rate.max-failures-per-interval: 300

It works when I set it up explicitly in topology using env.setRestartStrategy 

PFA snapshot of the Jobmanager log.
Thanks,
Deepak Jha

Reply | Threaded
Open this post in threaded view
|

Re: FailureRate Restart Strategy is not picked from Config file

Till Rohrmann
Hi Deepak,

are you running Flink streaming jobs with checkpointing enabled? In this
case Flink will check if you've set a restart strategy at your job and if
not it will set the fixed delay restart strategy. This will effectively
overwrite the default restart strategy which you define in the
flink-conf.yaml file.

Cheers,
Till

On Thu, Sep 22, 2016 at 10:01 PM, Deepak Jha <[hidden email]> wrote:

> Hi All,
> I tried to use FailureRate restart strategy by setting values for it in
> flink-conf.yaml but flink (v 1.1.2) did not pick it up.
>
> # Flink Restart strategy
> restart-strategy: failure-rate
> restart-strategy.failure-rate.delay: 120 s
> restart-strategy.failure-rate.failure-rate-interval: 12 minute
> restart-strategy.failure-rate.max-failures-per-interval: 300
>
> It works when I set it up explicitly in topology using
> *env.setRestartStrategy *
>
> PFA snapshot of the Jobmanager log.
> Thanks,
> Deepak Jha
>
>
Reply | Threaded
Open this post in threaded view
|

Re: FailureRate Restart Strategy is not picked from Config file

Deepak Jha
Hi Till,
yes, I have enabled checkpointing from my job. Thanks for your help :)

On Mon, Sep 26, 2016 at 3:18 AM, Till Rohrmann <[hidden email]> wrote:

> Hi Deepak,
>
> are you running Flink streaming jobs with checkpointing enabled? In this
> case Flink will check if you've set a restart strategy at your job and if
> not it will set the fixed delay restart strategy. This will effectively
> overwrite the default restart strategy which you define in the
> flink-conf.yaml file.
>
> Cheers,
> Till
>
> On Thu, Sep 22, 2016 at 10:01 PM, Deepak Jha <[hidden email]> wrote:
>
> > Hi All,
> > I tried to use FailureRate restart strategy by setting values for it in
> > flink-conf.yaml but flink (v 1.1.2) did not pick it up.
> >
> > # Flink Restart strategy
> > restart-strategy: failure-rate
> > restart-strategy.failure-rate.delay: 120 s
> > restart-strategy.failure-rate.failure-rate-interval: 12 minute
> > restart-strategy.failure-rate.max-failures-per-interval: 300
> >
> > It works when I set it up explicitly in topology using
> > *env.setRestartStrategy *
> >
> > PFA snapshot of the Jobmanager log.
> > Thanks,
> > Deepak Jha
> >
> >
>



--
Thanks,
Deepak Jha