[jira] [Created] (FLINK-9238) There are some questions about BuckeingSink when sinking data to S3.

[Shang Yuanchun (Jira)]

liuzhixin created FLINK-9238:
--------------------------------

             Summary: There are some questions about BuckeingSink when sinking data to S3.
                 Key: FLINK-9238
                 URL: https://issues.apache.org/jira/browse/FLINK-9238
             Project: Flink
          Issue Type: Bug
          Components: filesystem-connector
    Affects Versions: 1.4.2
            Reporter: liuzhixin
             Fix For: 1.4.2


When flink is sinking data to S3,  there are some IOExceptions from fs. For some reasons I throw the exceptions, then the job will restart.  Sometimes，fs.rename fails and there are pending part files which are from the last job and finished part files, but the count  of records is not the same，slight difference. The "Exactly once" should not be the results.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)