[jira] [Created] (FLINK-5942) Harden ZooKeeperStateHandleStore to deal with corrupted data

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-5942) Harden ZooKeeperStateHandleStore to deal with corrupted data

Shang Yuanchun (Jira)
Till Rohrmann created FLINK-5942:
------------------------------------

             Summary: Harden ZooKeeperStateHandleStore to deal with corrupted data
                 Key: FLINK-5942
                 URL: https://issues.apache.org/jira/browse/FLINK-5942
             Project: Flink
          Issue Type: Bug
          Components: State Backends, Checkpointing
    Affects Versions: 1.1.4, 1.2.0, 1.3.0
            Reporter: Till Rohrmann
            Assignee: Till Rohrmann


The {{ZooKeeperStateHandleStore}} cannot handle corrupted Znode data. When calling {{ZooKeeperStateHandleStore.getAll}} or {{getAllSortedByName}} and reading a node with corrupted data, the whole operation will fail. In such a situation, Flink won't be able to recover because it will read over and over again the same corrupted Znodes (in the recovery case). Therefore, I propose to ignore Znodes whose data cannot be read.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)