Stephan Ewen created FLINK-4904:
-----------------------------------
Summary: Add a limit for how much data may be spilled in checkpoint alignments
Key: FLINK-4904
URL:
https://issues.apache.org/jira/browse/FLINK-4904 Project: Flink
Issue Type: Improvement
Components: State Backends, Checkpointing
Affects Versions: 1.1.3
Reporter: Stephan Ewen
Assignee: Stephan Ewen
Fix For: 1.2.0, 1.1.4
This should act as a safety net in cases where the sources or the network misbehave or cannot start a checkpoint. The alignment phases would then simply abort after a while, signaling the checkpoint to be incomplete.
This needs the following changes
- Add "cancel barriers" that are sent to downstream tasks
- Barrier Buffer and Barrier Tracker need to handle the "cancel barriers"
- Tasks need to react to an aborted checkpoint by responding with an appropriate message
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)