[jira] [Created] (FLINK-16638) Flink checkStateMappingCompleteness doesn't include UserDefinedOperatorIDs

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-16638) Flink checkStateMappingCompleteness doesn't include UserDefinedOperatorIDs

Shang Yuanchun (Jira)
Bashar Abdul Jawad created FLINK-16638:
------------------------------------------

             Summary: Flink checkStateMappingCompleteness doesn't include UserDefinedOperatorIDs
                 Key: FLINK-16638
                 URL: https://issues.apache.org/jira/browse/FLINK-16638
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Checkpointing
    Affects Versions: 1.10.0
            Reporter: Bashar Abdul Jawad


[StateAssignmentOperation.checkStateMappingCompleteness|https://github.com/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/StateAssignmentOperation.java#L555] doesn't check for UserDefinedOperatorIDs (specified using setUidHash), causing the exception:

{code}
 java.lang.IllegalStateException: There is no operator for the state {}
{code}
to be thrown when a savepoint can't be mapped to an ExecutionJobVertex, even when the operator hash is explicitly specified.

I believe this logic should be extended to also include UserDefinedOperatorIDs as so:

{code:java}
for (ExecutionJobVertex executionJobVertex : tasks) {
  allOperatorIDs.addAll(executionJobVertex.getOperatorIDs());
  allOperatorIDs.addAll(executionJobVertex.getUserDefinedOperatorIDs());
}
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)