[jira] [Created] (FLINK-17487) Do not delete old checkpoints when stop the job.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-17487) Do not delete old checkpoints when stop the job.

Shang Yuanchun (Jira)
nobleyd created FLINK-17487:
-------------------------------

             Summary: Do not delete old checkpoints when stop the job.
                 Key: FLINK-17487
                 URL: https://issues.apache.org/jira/browse/FLINK-17487
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Checkpointing
            Reporter: nobleyd


When stop flink job using 'flink stop jobId', the checkpoints data is deleted. 

When the stop action is not succeed or failed because of some unknown errors, sometimes the job resumes using the latest checkpoint, while sometimes it just fails, and the checkpoints data is gone.

You may say why I need these checkpoints since I stop the job and a savepoint will be generated. For example, my job uses a kafka source, while the kafka missed some data, and I want to stop the job and resume it using an old checkpoint. Anyway, I mean sometimes the action stop is failed and the checkpoint data is also deleted, which is not good. 

This feature is different from the case 'flink cancel jobId' or 'flink savepoint jobId', which won't delete the checkpoint data.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)