[jira] [Created] (FLINK-11298) Scheduling job in the unit of concurrent groups

[Shang Yuanchun (Jira)]

shuai.xu created FLINK-11298:
--------------------------------

             Summary: Scheduling job in the unit of concurrent groups
                 Key: FLINK-11298
                 URL: https://issues.apache.org/jira/browse/FLINK-11298
             Project: Flink
          Issue Type: Improvement
          Components: JobManager
            Reporter: shuai.xu


Now flink only support two scheduling modes, that's scheduling all tasks Eager for streaming jobs and scheduling all task Lazy_from_source for batch jobs. This is not flexible enough for the various requirements of different job such as FLINK-10240. We proposal a new ConcurrentSchedulingGroup based scheduling strategy which first split a job into serval concurrent groups and then schedule it in the unit of concurrent groups. This strategy will support not only the existing EAGER and LAZY_FROM_SOURCE mode but also other situation such as the Build/Probe in FLINK-10240.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)