[jira] [Created] (FLINK-20791) Support local aggregate push down for Blink batch planner

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-20791) Support local aggregate push down for Blink batch planner

Shang Yuanchun (Jira)
Sebastian Liu created FLINK-20791:
-------------------------------------

             Summary: Support local aggregate push down for Blink batch planner
                 Key: FLINK-20791
                 URL: https://issues.apache.org/jira/browse/FLINK-20791
             Project: Flink
          Issue Type: New Feature
          Components: Table SQL / API, Table SQL / Planner
            Reporter: Sebastian Liu


Aggregate operator of Flink SQL is currently fully done at Flink layer. With the developing of storage, many downstream storage of Flink SQL has the ability to deal with Aggregation operator.
Pushing down Aggregate to data source layer will improve performance from the perspective of the network IO and computation overhead.
 
I have drafted a design doc for this new feature. [https://docs.google.com/document/d/1kGwC_h4qBNxF2eMEz6T6arByOB8yilrPLqDN0QBQXW4/edit?usp=sharing]
 
Any comment or discussion is welcome.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)