[jira] [Created] (FLINK-1591) Remove window merge before flatten as an optimization

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-1591) Remove window merge before flatten as an optimization

Shang Yuanchun (Jira)
Gyula Fora created FLINK-1591:
---------------------------------

             Summary: Remove window merge before flatten as an optimization
                 Key: FLINK-1591
                 URL: https://issues.apache.org/jira/browse/FLINK-1591
             Project: Flink
          Issue Type: Improvement
          Components: Streaming
            Reporter: Gyula Fora


After a Window Reduce or Map transformation there is always a merge step when the transformation was parallel or grouped.

This merge step should be removed when the windowing operator is followed by flatten to avoid unnecessary bottlenecks in the program.

This feature should be added as an optimization step to the WindowingOptimizer class.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)