[jira] [Created] (FLINK-8602) Accelerate recover from failover when use incremental checkpoint

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-8602) Accelerate recover from failover when use incremental checkpoint

Shang Yuanchun (Jira)
Sihua Zhou created FLINK-8602:
---------------------------------

             Summary: Accelerate recover from failover when use incremental checkpoint
                 Key: FLINK-8602
                 URL: https://issues.apache.org/jira/browse/FLINK-8602
             Project: Flink
          Issue Type: Improvement
          Components: State Backends, Checkpointing
    Affects Versions: 1.4.0
            Reporter: Sihua Zhou
            Assignee: Sihua Zhou


Currently, when enable incremental checkpoint, if user change the parallelism then `hasExtraKeys` may be `true`. If this occur, flink will loop all rocksdb instance and iterator all data to fetch the data that fails into current `KeyGroupRange`, this can be improved because

 if a state handle's `KeyGroupRange` is fully covered by  current `KeyGroupRange`, we can open the rocksdb it corresponded directly.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)