[jira] [Created] (FLINK-16369) Allow the StreamingFileSink to restore from a previous (old) savepoint.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-16369) Allow the StreamingFileSink to restore from a previous (old) savepoint.

Shang Yuanchun (Jira)
Kostas Kloudas created FLINK-16369:
--------------------------------------

             Summary: Allow the StreamingFileSink to restore from a previous (old) savepoint.
                 Key: FLINK-16369
                 URL: https://issues.apache.org/jira/browse/FLINK-16369
             Project: Flink
          Issue Type: New Feature
          Components: Connectors / FileSystem
    Affects Versions: 1.11.0
            Reporter: Kostas Kloudas


Currently the StreamingFileSink will fail upon recovery if the "in-progress" temporary file is not there anymore. This can happen either because of an error (someone deleted the file) or because the file was eventually committed after the savepoint was taken and is when we try to restore, it is in the FINALIZED state.

This issue will track the progress of alleviating this limitation.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)