[DISCUSS] FLIP-168: Speculative execution for Batch Job

Posted by wangwj on Jun 20, 2021; 2:35pm
URL: http://deprecated-apache-flink-mailing-list-archive.368.s1.nabble.com/DISCUSS-FLIP-168-Speculative-execution-for-Batch-Job-tp51516.html

Hi everyone,

I would like to kick off a discussion on speculative execution for batch job.

I have created FLIP-168 [1] that clarifies my motivation to do this and some improvement proposals for the new design.  

It would be great to resolve the problem of long tail task in batch job.

Please let me know your thoughts. Thanks.

Regards
wangwj

[1]https://cwiki.apache.org/confluence/display/FLINK/FLIP-168%3A+Speculative+execution+for+Batch+Job