[jira] [Created] (FLINK-21066) Refactor the CheckpointCoordinator to compute the tasks to trigger/wait/commit dynamically

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-21066) Refactor the CheckpointCoordinator to compute the tasks to trigger/wait/commit dynamically

Shang Yuanchun (Jira)
Yun Gao created FLINK-21066:
-------------------------------

             Summary: Refactor the CheckpointCoordinator to compute the tasks to trigger/wait/commit dynamically
                 Key: FLINK-21066
                 URL: https://issues.apache.org/jira/browse/FLINK-21066
             Project: Flink
          Issue Type: Sub-task
            Reporter: Yun Gao


Currently Flink would identify the tasks to trigger/wait/commit in compile phase, and pass them to the CheckpointCoordinator via JobGraph and cache them in CheckpointCoordinator. However, to support checkpoint after some tasks finished, we might need to recompute the tasks to trigger/wait/commit for each checkpoint, thus we would first refactor CheckpointCoordinator to compute the tasks to trigger/wait/commit dynamically, but keeps the computing logic unchange (e.g., tasks to trigger are source tasks and tasks to wait/commit are all tasks)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)