[jira] [Created] (FLINK-11391) Introduce ShuffleMaster in Job Master

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11391) Introduce ShuffleMaster in Job Master

Shang Yuanchun (Jira)
Andrey Zagrebin created FLINK-11391:
---------------------------------------

             Summary: Introduce ShuffleMaster in Job Master
                 Key: FLINK-11391
                 URL: https://issues.apache.org/jira/browse/FLINK-11391
             Project: Flink
          Issue Type: Sub-task
          Components: Network
            Reporter: Andrey Zagrebin
            Assignee: zhijiang
             Fix For: 1.8.0


* Implement _PartitionShuffleDescriptor_ for covering necessary abstract info.
 * Implement _ShuffleDeploymentDecriptor_ generated from _PartitionShuffleDecriptor_.
 * Define _ShuffleMaster_ interface and create a simple implementation on JM side which relies on currently implemented NetworkEnviroment on TM side.
 * Define _ShuffleManager_ interface for creating ShuffleMaster.
 * Introduce a Flink configuration option for _ShuffleManager_ implementation. Default value for it could be <none> which serves as a feature flag at the moment to use current code paths.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)