Posted by
Shang Yuanchun (Jira) on
URL: http://deprecated-apache-flink-mailing-list-archive.368.s1.nabble.com/jira-Created-FLINK-22962-Key-group-is-not-in-KeyGroupRange-error-while-checkpointing-tp51323.html
Prateek Kohli created FLINK-22962:
-------------------------------------
Summary: Key group is not in KeyGroupRange error while checkpointing
Key: FLINK-22962
URL:
https://issues.apache.org/jira/browse/FLINK-22962 Project: Flink
Issue Type: Bug
Components: Runtime / State Backends
Affects Versions: 1.12.1
Environment: Linux
Reporter: Prateek Kohli
Hi,
We are getting the below exception while using rocksdb as state backend at the time of checkpointing:
2021-06-10 12:05:13,933 INFO org.apache.flink.streaming.runtime.tasks.AsyncCheckpointRunnable [] - Aggregator (3/4)#0 - asynchronous part of checkpoint 2 could not be completed.
java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Key group 0 is not in KeyGroupRange\{startKeyGroup=5, endKeyGroup=7}.
at java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[?:1.8.0_261]
at java.util.concurrent.FutureTask.get(FutureTask.java:192) ~[?:1.8.0_261]
at org.apache.flink.runtime.concurrent.FutureUtils.runIfNotDoneAndGet(FutureUtils.java:621) ~[flink-dist_2.11-1.12.1.jar:1.12.1]
at org.apache.flink.streaming.api.operators.OperatorSnapshotFinalizer.<init>(OperatorSnapshotFinalizer.java:54) ~[flink-streaming-java_2.11-1.12.1.jar:1.12.1]
at org.apache.flink.streaming.runtime.tasks.AsyncCheckpointRunnable.run(AsyncCheckpointRunnable.java:122) [flink-streaming-java_2.11-1.12.1.jar:1.12.1]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_261]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_261]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_261]
Caused by: java.lang.IllegalArgumentException: Key group 0 is not in KeyGroupRange\{startKeyGroup=5, endKeyGroup=7}.
at org.apache.flink.runtime.state.KeyGroupRangeOffsets.computeKeyGroupIndex(KeyGroupRangeOffsets.java:144) ~[flink-dist_2.11-1.12.1.jar:1.12.1]
at org.apache.flink.runtime.state.KeyGroupRangeOffsets.setKeyGroupOffset(KeyGroupRangeOffsets.java:106) ~[flink-dist_2.11-1.12.1.jar:1.12.1]
at org.apache.flink.contrib.streaming.state.snapshot.RocksFullSnapshotStrategy$SnapshotAsynchronousPartCallable.writeKVStateData(RocksFullSnapshotStrategy.java:333) ~[flink-dist_2.11-1.12.1.jar:1.12.1]
at org.apache.flink.contrib.streaming.state.snapshot.RocksFullSnapshotStrategy$SnapshotAsynchronousPartCallable.writeSnapshotToOutputStream(RocksFullSnapshotStrategy.java:264) ~[flink-dist_2.11-1.12.1.jar:1.12.1]
at org.apache.flink.contrib.streaming.state.snapshot.RocksFullSnapshotStrategy$SnapshotAsynchronousPartCallable.callInternal(RocksFullSnapshotStrategy.java:227) ~[flink-dist_2.11-1.12.1.jar:1.12.1]
at org.apache.flink.contrib.streaming.state.snapshot.RocksFullSnapshotStrategy$SnapshotAsynchronousPartCallable.callInternal(RocksFullSnapshotStrategy.java:180) ~[flink-dist_2.11-1.12.1.jar:1.12.1]
at org.apache.flink.runtime.state.AsyncSnapshotCallable.call(AsyncSnapshotCallable.java:78) ~[flink-dist_2.11-1.12.1.jar:1.12.1]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_261]
at org.apache.flink.runtime.concurrent.FutureUtils.runIfNotDoneAndGet(FutureUtils.java:618) ~[flink-dist_2.11-1.12.1.jar:1.12.1]
... 5 more
When we change the state backend to file or heap we do not get this error.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)