[jira] [Created] (FLINK-22993) CompactFileWriter won't emit EndCheckpoint with Long.MAX_VALUE checkpointId

[Shang Yuanchun (Jira)]

luoyuxia created FLINK-22993:
--------------------------------

             Summary: CompactFileWriter won't emit EndCheckpoint with Long.MAX_VALUE checkpointId
                 Key: FLINK-22993
                 URL: https://issues.apache.org/jira/browse/FLINK-22993
             Project: Flink
          Issue Type: Bug
          Components: Connectors / FileSystem, Connectors / Hive
    Affects Versions: 1.13.0
            Reporter: luoyuxia
             Fix For: 1.14.0


CompactFileWriter won't emit EndCheckpoint with Long.MAX_VALUE checkpointId even though the inputs end. 

It will cause data lose. For example, after completing checkpoint 5, CompactFileWriter write some file, then the inputs end, but it won't emit EndCheckpoint  with Long.MAX_VALUE checkpointId, so the downstream operator won't do the compaction for the files which means these files are invisible.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)