[jira] [Created] (FLINK-13856) Reduce the delete file api when the checkpoint is completed

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-13856) Reduce the delete file api when the checkpoint is completed

Shang Yuanchun (Jira)
andrew.D.lin created FLINK-13856:
------------------------------------

             Summary: Reduce the delete file api when the checkpoint is completed
                 Key: FLINK-13856
                 URL: https://issues.apache.org/jira/browse/FLINK-13856
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / State Backends
    Affects Versions: 1.9.0, 1.8.1
            Reporter: andrew.D.lin
         Attachments: f6cc56b7-2c74-4f4b-bb6a-476d28a22096.png

When the new checkpoint is completed, an old checkpoint will be deleted by calling CompletedCheckpoint.discardOnSubsume().

When deleting old checkpoints, follow these steps:
1, drop the metadata
2, discard private state objects
3, discard location as a whole

In some cases, is it possible to delete the checkpoint folder recursively by one call?

As far as I know the full amount of checkpoint, it should be possible to delete the folder directly.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)