[jira] [Created] (FLINK-17020) Introduce GlobalDataExchangeMode for JobGraph Generation

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-17020) Introduce GlobalDataExchangeMode for JobGraph Generation

Shang Yuanchun (Jira)
Zhu Zhu created FLINK-17020:
-------------------------------

             Summary: Introduce GlobalDataExchangeMode for JobGraph Generation
                 Key: FLINK-17020
                 URL: https://issues.apache.org/jira/browse/FLINK-17020
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Coordination
    Affects Versions: 1.11.0
            Reporter: Zhu Zhu
             Fix For: 1.11.0


Introduce GlobalDataExchangeMode with 4 modes:
 * ALL_EDGES_BLOCKING
 * FORWARD_EDGES_PIPELINED
 * POINTWISE_EDGES_PIPELINED
 * ALL_EDGES_PIPELINED

StreamGraph will be extended with a new field to host the GlobalDataExchangeMode. In the JobGraph generation stage, this mode will be used to determine the data exchange type of each job edge.

More details see [FLIP-119#Global Data Exchange Mode|https://cwiki.apache.org/confluence/display/FLINK/FLIP-119+Pipelined+Region+Scheduling#FLIP-119PipelinedRegionScheduling-GlobalDataExchangeMode]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)