[jira] [Created] (FLINK-19359) Restore from Checkpoint fails if checkpoint folders is corrupt/partial

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-19359) Restore from Checkpoint fails if checkpoint folders is corrupt/partial

Shang Yuanchun (Jira)
Arpith Prakash created FLINK-19359:
--------------------------------------

             Summary: Restore from Checkpoint fails if checkpoint folders is corrupt/partial
                 Key: FLINK-19359
                 URL: https://issues.apache.org/jira/browse/FLINK-19359
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Checkpointing
    Affects Versions: 1.8.0
            Reporter: Arpith Prakash
         Attachments: Checkpoints.png

I'm using Flink 1.8.0 version and have enabled externalized checkpoint to hdfs location, we have seen few scenarios where checkpoint folders will have checkpoint files but only missing "*_metadata*" file. If we attempt to restore application from this path, application fails with exception "Could not find *_metadata* file. There is similar discussion in Flink user mailing list with subject  "Zookeeper connection loss causing checkpoint corruption" around it. I've attached sample snapshot on how folder structure looks as well.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)