[jira] [Created] (FLINK-12062) Introduce bundle operator to streaming table runtime

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-12062) Introduce bundle operator to streaming table runtime

Shang Yuanchun (Jira)
Kurt Young created FLINK-12062:
----------------------------------

             Summary: Introduce bundle operator to streaming table runtime
                 Key: FLINK-12062
                 URL: https://issues.apache.org/jira/browse/FLINK-12062
             Project: Flink
          Issue Type: Improvement
          Components: Table SQL / Runtime
            Reporter: Kurt Young


Bundle operator will try to save incoming records in a key-value map. Once bundler triggers, the bundle function will be invoked. All buffered data will be passed in, and one can do some optimizations based on this. 

One useful scenario for bundle operator is "Group Aggregate". We can organize the bundle data with grouping key. Once bundle triggers, we can first pre aggregate all data belongs to same key in memory, then we only have to operate with state once for each key. This will save lots of cost and have better performance.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)