[jira] [Created] (FLINK-13452) Pipelined region failover strategy does not recover Job if checkpoint cannot be read

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-13452) Pipelined region failover strategy does not recover Job if checkpoint cannot be read

Shang Yuanchun (Jira)
Gary Yao created FLINK-13452:
--------------------------------

             Summary: Pipelined region failover strategy does not recover Job if checkpoint cannot be read
                 Key: FLINK-13452
                 URL: https://issues.apache.org/jira/browse/FLINK-13452
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Coordination
    Affects Versions: 1.9.0, 1.10.0
            Reporter: Gary Yao
            Assignee: Gary Yao
             Fix For: 1.9.0
         Attachments: jobmanager.log

The job does not recover if a checkpoint cannot be read and {{jobmanager.execution.failover-strategy}} is set to _"region"_.

*Analysis*

The {{RestartCallback}} created by {{AdaptedRestartPipelinedRegionStrategyNG}} throws a \{{RuntimeException}} if no checkpoints could be read. When the restart is invoked in a separate thread pool, the exception is swallowed. See:

[https://github.com/apache/flink/blob/21621fbcde534969b748f21e9f8983e3f4e0fb1d/flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/failover/AdaptedRestartPipelinedRegionStrategyNG.java#L117-L119]

[https://github.com/apache/flink/blob/21621fbcde534969b748f21e9f8983e3f4e0fb1d/flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/restart/FixedDelayRestartStrategy.java#L65]

*Expected behavior*
 * Job should restart

 



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)