[jira] [Created] (FLINK-21650) On heap state restore, skip key groups from other state backends

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-21650) On heap state restore, skip key groups from other state backends

Shang Yuanchun (Jira)
Roman Khachatryan created FLINK-21650:
-----------------------------------------

             Summary: On heap state restore, skip key groups from other state backends
                 Key: FLINK-21650
                 URL: https://issues.apache.org/jira/browse/FLINK-21650
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / State Backends
            Reporter: Roman Khachatryan
            Assignee: Roman Khachatryan
             Fix For: 1.13.0


In new incremental mode, heap backend wraps KeyGroupsStateHandle
into IncrementalRemoteKeyedStateHandle. The latter don't compute
intersection because it is not directly aware of the offsets. So it just
returns a full keyrange if there is SOME intersection.
On recovery, unused keyGroups are filtered out by RocksDB state backend.
With this change, Heap state backend does the same.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)