[jira] [Created] (FLINK-20172) Unify the behavior for file committers when the source or dest files are not exists

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-20172) Unify the behavior for file committers when the source or dest files are not exists

Shang Yuanchun (Jira)
Yun Gao created FLINK-20172:
-------------------------------

             Summary: Unify the behavior for file committers when the source or dest files are not exists
                 Key: FLINK-20172
                 URL: https://issues.apache.org/jira/browse/FLINK-20172
             Project: Flink
          Issue Type: Improvement
            Reporter: Yun Gao


As discussed in https://github.com/apache/flink/pull/14061#discussion_r523923047, currently for `StreamingFileSink` or `FileSink`, the behavior is not consistency when restored from staled checkpoints / savepoints, some would ignore the missed files while others might throw exceptions. Therefore, we might unify the behavior for the different committers.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)