[jira] [Created] (FLINK-12693) Store state per key-group in CopyOnWriteStateTable

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-12693) Store state per key-group in CopyOnWriteStateTable

Shang Yuanchun (Jira)
Yu Li created FLINK-12693:
-----------------------------

             Summary: Store state per key-group in CopyOnWriteStateTable
                 Key: FLINK-12693
                 URL: https://issues.apache.org/jira/browse/FLINK-12693
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / State Backends
            Reporter: Yu Li
            Assignee: Yu Li


Since we propose to use KeyGroup as the unit of spilling/loading, the first step is to store state per key-groups. Currently {{NestedMapsStateTable}} natively supports this, so we only need to refine {{CopyOnWriteStateTable}}

The main efforts required here is to extract the customized hash-map out of {{CopyOnWriteStateTable}} then use such a hash-map as the state holder for each KeyGroup. Whereafter we could extract some common logic out into {{StateTable}}.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)