[jira] [Created] (FLINK-17014) Implement PipelinedRegionSchedulingStrategy

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-17014) Implement PipelinedRegionSchedulingStrategy

Shang Yuanchun (Jira)
Zhu Zhu created FLINK-17014:
-------------------------------

             Summary: Implement PipelinedRegionSchedulingStrategy
                 Key: FLINK-17014
                 URL: https://issues.apache.org/jira/browse/FLINK-17014
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Coordination
    Affects Versions: 1.11.0
            Reporter: Zhu Zhu
             Fix For: 1.11.0


The PipelinedRegionSchedulingStrategy submits one pipelined region to the DefaultScheduler each time. The PipelinedRegionSchedulingStrategy must be aware of the inputs of each pipelined region. It should schedule a region if and only if all the inputs of that region become consumable.

PipelinedRegionSchedulingStrategy can implement as below:
 * startScheduling() : schedule all source regions one by one.
 * onPartitionConsumable(partition) : Check all the consumer regions of the notified partition, if all the inputs of a region have turned to be consumable, schedule the region
 * restartTasks(tasksToRestart) : find out all regions which contain the tasks to restart, reschedule those whose inputs are all consumable



--
This message was sent by Atlassian Jira
(v8.3.4#803005)