Unaligned checkpoints enabled by default for Flink CI builds on master

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Unaligned checkpoints enabled by default for Flink CI builds on master

Arvid Heise-3
Hi devs,

just a heads-up that we enabled the new unaligned checkpoints by default on
all tests to battletest this new feature. We made sure that unaligned
checkpoints are mature enough for that change and waited for 1.11 to be
done. Note that this doesn't affect any setup outside of our azure builds.
For users, it's still disabled by default.

If your tests use recovery and you see strange unexplainable behavior
(corrupted stream, unexpected output) after yesterday it might be an issue
with unaligned checkpoints. Just keep that in the back of your head, don't
become insane if you encounter such behavior, and ping someone with
checkpointing knowledge.

You can disable unaligned checkpoints in a specific test by using

env.getCheckpointConfig().enableUnalignedCheckpoints(false);

in your test setup or globally by overwriting the (system) property

execution.checkpointing.unaligned


Thanks for helping us to improve this feature,

Arvid

--

Arvid Heise | Senior Java Developer

<https://www.ververica.com/>

Follow us @VervericaData

--

Join Flink Forward <https://flink-forward.org/> - The Apache Flink
Conference

Stream Processing | Event Driven | Real Time

--

Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany

--
Ververica GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji
(Toni) Cheng