[jira] [Created] (FLINK-22136) Device application for unaligned checkpoint test on cluster

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-22136) Device application for unaligned checkpoint test on cluster

Shang Yuanchun (Jira)
Arvid Heise created FLINK-22136:
-----------------------------------

             Summary: Device application for unaligned checkpoint test on cluster
                 Key: FLINK-22136
                 URL: https://issues.apache.org/jira/browse/FLINK-22136
             Project: Flink
          Issue Type: Sub-task
            Reporter: Arvid Heise


To test unaligned checkpoints, we should use a few different applications that use different features:

*     Mixing forward/rescale channels with keyby or other shuffle operations
*     Unions
*     2 or n-ary operators
*     Associated state ((keyed) process function)
*     Correctness verifications

The sinks should not be mocked but rather should be able to induce a fair amount of backpressure into the system. Quite possibly, it would be a good idea to have a way to add more backpressure to the sink by running the respective system on the cluster and be able to add/remove parallel instances.





--
This message was sent by Atlassian Jira
(v8.3.4#803005)