[jira] [Created] (FLINK-22008) writing metadata is not an atomic operation, we should add a commit logic

[Shang Yuanchun (Jira)]

xiaogang zhou created FLINK-22008:
-------------------------------------

             Summary: writing metadata is not an atomic operation, we should add a commit logic
                 Key: FLINK-22008
                 URL: https://issues.apache.org/jira/browse/FLINK-22008
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Checkpointing
    Affects Versions: 1.12.2
            Reporter: xiaogang zhou


writing metadata is not an atomic operation, some logic can cause there is a metadata file in the checkpoint dir, but the data is corrupted if the jobmanager crash while writing the metadata. 

 

So we should consider to add commit operation in the checkpoint storage location



--
This message was sent by Atlassian Jira
(v8.3.4#803005)