Unable to resolve the operator from the metafile using State Processor API

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Unable to resolve the operator from the metafile using State Processor API

Partha Mishra

Hi,

 

I have specified operator uuid for all of my operator in Flink job and triggered a savepoint and `_metafile` got generated. When I use state processor APIs to read the saved snapshot and try to read the mapping, I am not able to resolve which operator id map to which operator in my code.

1.       Is there a way to find it?

2.      What is the hashing technique for the operator id?

 

 

Below is the generated savepoint mapping when trying to read from the State Processor APIs – but I am not able to resolve `d7741f4a6cdf388e747557749a0f0d21` corresponds to which operator? If I  know the hashing logic, it becomes easier for me to get the same.

 

 

{d7741f4a6cdf388e747557749a0f0d21=org.apache.flink.state.api.runtime.metadata.OperatorStateSpec@5af97850, 94e9d5a34992b6c51461d69a7ca2eb56=org.apache.flink.state.api.runtime.metadata.OperatorStateSpec@5ef60048, 647a0a5ff84846c52775ce89f51a5edc=org.apache.flink.state.api.runtime.metadata.OperatorStateSpec@1d548a08, 2345cb61bbb2fcd603d786389726830c=org.apache.flink.state.api.runtime.metadata.OperatorStateSpec@16aa0a0a, 76f74784cdf272cbdd1c37d471a532a0=org.apache.flink.state.api.runtime.metadata.OperatorStateSpec@780cb77, bdf3ca0e5e6bde27f22d80457a5a19a9=org.apache.flink.state.api.runtime.metadata.OperatorStateSpec@691a7f8f, da9aa6f89ab75dbc6233a02db1b171fd=org.apache.flink.state.api.runtime.metadata.OperatorStateSpec@50a7bc6e, 43b792ffaf5a610180059cb432d4a71d=org.apache.flink.state.api.runtime.metadata.OperatorStateSpec@161b062a, afa3664e2d13439221e8d041382a4dc1=org.apache.flink.state.api.runtime.metadata.OperatorStateSpec@17c1bced}