[jira] [Created] (FLINK-9260) Introduce a friendly way to resume the job from externalized checkpoints automatically

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-9260) Introduce a friendly way to resume the job from externalized checkpoints automatically

Shang Yuanchun (Jira)
Sihua Zhou created FLINK-9260:
---------------------------------

             Summary: Introduce a friendly way to resume the job from externalized checkpoints automatically
                 Key: FLINK-9260
                 URL: https://issues.apache.org/jira/browse/FLINK-9260
             Project: Flink
          Issue Type: Improvement
          Components: Client
    Affects Versions: 1.5.0
            Reporter: Sihua Zhou
            Assignee: Sihua Zhou
             Fix For: 1.6.0


Currently, it's quite a bit not friendly for users to recover job from the externalized checkpoint, user need to find the dedicate dir for the job which is not a easy thing when there are too many jobs. This ticket attend to introduce a more friendly way to allow the user to use the externalized checkpoint to do recovery.

The implementation steps are copied from the comments of [~StephanEwen] in [9043|https://issues.apache.org/jira/browse/FLINK-9043]

- We could make this an option where you pass a flag (-r) to automatically look for the latest checkpoint in a given directory.
- If more than one jobs checkpointed there before, this operation would fail.
- We might also need a way to have jobs not create the UUID subdirectory, otherwise the scanning for the latest checkpoint would not easily work.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)