[jira] [Created] (FLINK-21178) Task failure will not trigger master hook's reset()

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-21178) Task failure will not trigger master hook's reset()

Shang Yuanchun (Jira)
Brian Zhou created FLINK-21178:
----------------------------------

             Summary: Task failure will not trigger master hook's reset()
                 Key: FLINK-21178
                 URL: https://issues.apache.org/jira/browse/FLINK-21178
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Checkpointing
    Affects Versions: 1.11.3, 1.12.0
            Reporter: Brian Zhou


In Pravega Flink connector integration with Flink 1.12, we found an issue with our no-checkpoint recovery test case [1].

We expect the recovery will call the ReaderCheckpointHook::reset() function which was the behaviour before 1.12. However FLINK-20222 changes the logic, the reset() call will only be called along with a global recovery. This causes Pravega source data loss when failure happens before the first checkpoint.

[1]  [https://github.com/crazyzhou/flink-connectors/blob/da9f76d04404071471ebd86bf6889b307c9122ff/src/test/java/io/pravega/connectors/flink/FlinkPravegaReaderRGStateITCase.java#L78]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)