[jira] [Created] (FLINK-6545) Make incremental checkpoints externalizable

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-6545) Make incremental checkpoints externalizable

Shang Yuanchun (Jira)
Stefan Richter created FLINK-6545:
-------------------------------------

             Summary: Make incremental checkpoints externalizable
                 Key: FLINK-6545
                 URL: https://issues.apache.org/jira/browse/FLINK-6545
             Project: Flink
          Issue Type: Sub-task
          Components: State Backends, Checkpointing
    Affects Versions: 1.3.0
            Reporter: Stefan Richter
            Priority: Blocker
             Fix For: 1.3.0


Incremental checkpoints are currently not externalizible. The missing piece is familiarizing the {{SavepointSerializer}}(s) with the new state handles classes that we added for incremental checkpointing. Currently, some of those (e.g. {{org.apache.flink.contrib.streaming.state.RocksDBIncrementalKeyedStateHandle}}) currently live in the contrib.rocksdb package and need to be migrated. We can also push them to a different abstraction level, i.e. {{IncrementalKeyedStateHandle}} with some private data, referenced existing shared data (from previous checkpoints), and (presumably) newly created shared data (first created by the current checkpoint).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)