[jira] [Created] (FLINK-20721) Remove unknown input channels and process to update partitions

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-20721) Remove unknown input channels and process to update partitions

Shang Yuanchun (Jira)
Zhu Zhu created FLINK-20721:
-------------------------------

             Summary: Remove unknown input channels and process to update partitions
                 Key: FLINK-20721
                 URL: https://issues.apache.org/jira/browse/FLINK-20721
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Coordination, Runtime / Network
    Affects Versions: 1.13.0
            Reporter: Zhu Zhu
             Fix For: 1.13.0


With the latest pipelined region scheduling, Flink no longer launch a task before knowing the locations of all the partitions it consumes. `scheduleOrUpdateConsumers` is no longer needed so we removed it in FLINK-20439.

Unknown input channels and the process to update it is also no longer needed. I'd propose to remove them and the benefits are:
1. simplifying the code of both scheduler and shuffle components
2. simplifying interfaces of ShuffleEnvironment and ShuffleDescriptor
3. ensure the assumptions in InputGate#resumeConsumption() implementations
4. allow to remove ScheduleMode#allowLazyDeployment() and later completely remove ScheduleMode





--
This message was sent by Atlassian Jira
(v8.3.4#803005)