Hey Everyone!
Gordon and I have been discussing adding a savepoint connector to flink for
reading, writing and modifying savepoints.
This is useful for:
- Analyzing state for interesting patterns
- Troubleshooting or auditing jobs by checking for discrepancies in state
- Bootstrapping state for new applications
- Modifying savepoints such as:
- Changing max parallelism
- Making breaking schema changes
- Correcting invalid state
We are looking forward to your feedback!
This is the FLIP:
https://cwiki.apache.org/confluence/display/FLINK/FLIP-42%3A+Savepoint+Connector<
https://cwiki.apache.org/confluence/display/FLINK/FLIP-41%3A+Unify+Keyed+State+Snapshot+Binary+Format+for+Savepoints>
.
--
Seth Wiesman