[jira] [Created] (FLINK-2283) Make grouped reduce/fold/aggregations stateful using Partitioned state

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-2283) Make grouped reduce/fold/aggregations stateful using Partitioned state

Shang Yuanchun (Jira)
Gyula Fora created FLINK-2283:
---------------------------------

             Summary: Make grouped reduce/fold/aggregations stateful using Partitioned state
                 Key: FLINK-2283
                 URL: https://issues.apache.org/jira/browse/FLINK-2283
             Project: Flink
          Issue Type: Improvement
          Components: Streaming
    Affects Versions: 0.10
            Reporter: Gyula Fora
            Priority: Minor


Currently the inner state of the grouped aggregations are not persisted as an operator state.

These operators should be reimplemented to use the newly introduced partitioned state abstractions which will make them fault tolerant and scalable for the future.

A suggested implementation would be to use a stateful mapper to implement the desired behaviour.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)