[DISCUSS] FLIP-42: Savepoint Connector

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[DISCUSS] FLIP-42: Savepoint Connector

Seth Wiesman-3
Hey Everyone!

Gordon and I have been discussing adding a savepoint connector to flink for
reading, writing and modifying savepoints.

This is useful for:

   - Analyzing state for interesting patterns
   - Troubleshooting or auditing jobs by checking for discrepancies in state
   - Bootstrapping state for new applications
   - Modifying savepoints such as:
      - Changing max parallelism
      - Making breaking schema changes
      - Correcting invalid state

We are looking forward to your feedback!

This is the FLIP:
https://cwiki.apache.org/confluence/display/FLINK/FLIP-42%3A+Savepoint+Connector
<https://cwiki.apache.org/confluence/display/FLINK/FLIP-41%3A+Unify+Keyed+State+Snapshot+Binary+Format+for+Savepoints>
.
--

Seth Wiesman