[jira] [Created] (FLINK-3480) Add hash-based strategy for ReduceFunction

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-3480) Add hash-based strategy for ReduceFunction

Shang Yuanchun (Jira)
Fabian Hueske created FLINK-3480:
------------------------------------

             Summary: Add hash-based strategy for ReduceFunction
                 Key: FLINK-3480
                 URL: https://issues.apache.org/jira/browse/FLINK-3480
             Project: Flink
          Issue Type: Sub-task
          Components: Local Runtime
            Reporter: Fabian Hueske


This issue is related to FLINK-3477.
While FLINK-3477 proposes to add hash-based combine strategy for ReduceFunction, this issue aims to add a hash-based strategy for the final aggregation.

This will need again a special hash-table aggregation which allows for in-place updates and append updates. However, it also needs to support spilling to disk in case of too tight memory budgets.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)