[jira] [Created] (FLINK-2335) Rework iteration construction in StreamGraph

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-2335) Rework iteration construction in StreamGraph

Shang Yuanchun (Jira)
Gyula Fora created FLINK-2335:
---------------------------------

             Summary: Rework iteration construction in StreamGraph
                 Key: FLINK-2335
                 URL: https://issues.apache.org/jira/browse/FLINK-2335
             Project: Flink
          Issue Type: Improvement
          Components: Streaming
            Reporter: Gyula Fora
            Assignee: Gyula Fora


Currently the nodes representing the extra sinks and sources are incrementally added to the streamgraph when the user creates the iterative parts of the program.

This makes it difficult to enforce different partitioning schemes on the feedback edges and also makes it virtually impossible to handle more iteration heads with different parallelism.

The actual nodes in the streamgraph for the iteration sinks/sources should only be created when the program is finalized  after the user calls execute and before we create the jobgraph.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)