Tzu-Li (Gordon) Tai created FLINK-9322:
------------------------------------------
Summary: Add exception throwing map function that simulates failures to the general purpose DataStream job
Key: FLINK-9322
URL:
https://issues.apache.org/jira/browse/FLINK-9322 Project: Flink
Issue Type: Sub-task
Components: Tests
Reporter: Tzu-Li (Gordon) Tai
Assignee: Tzu-Li (Gordon) Tai
The general purpose DataStream job currently does not have any functionality to simulate user job failures.
We can achieve this by:
- Adding a simple-pass map function, that throws exceptions after a certain criteria is met
- To allow for the end-to-end tests that we have in mind, criteria could be to fail after 1) processing X records, and 2) Y completed checkpoints (see FLINK-8977)
- We should also allow specifying how many times to fail. Some chaos monkey tests (see FLINK-8973) would need to continuously fail several times, while FLINK-8977, for example, only needs to fail once.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
Locked
