[jira] [Created] (FLINK-21504) Enrich checkpoint barriers with information previous checkpoint(s)

[Shang Yuanchun (Jira)]

Roman Khachatryan created FLINK-21504:
-----------------------------------------

             Summary: Enrich checkpoint barriers with information previous checkpoint(s)
                 Key: FLINK-21504
                 URL: https://issues.apache.org/jira/browse/FLINK-21504
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Checkpointing
            Reporter: Roman Khachatryan
            Assignee: Roman Khachatryan


As discussed in [https://lists.apache.org/thread.html/r0b90330094ef356997399e4b657e42e6b09fdd731d3069d8bb9841d9%40%3Cdev.flink.apache.org%3E]

FLIP-151 and FLIP-158 would benefit from adding latest confirmed checkpoint id to the checkpoint barriers and RPC.

More specifically, knowing the latest confirmed checkpoint at the time of performing a new one would allow to:
 * avoid otherwise unnecessary re-uploading of state changes
 * cleanup state changes uploaded to DFS and sent to JM but not used by the JM

Adding earliest non-subsumed checkpoint ID would be another way to prevent FLINK-21351.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)