[jira] [Created] (FLINK-17542) Unify slot request timeout handling for streaming and batch tasks

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-17542) Unify slot request timeout handling for streaming and batch tasks

Shang Yuanchun (Jira)
Zhu Zhu created FLINK-17542:
-------------------------------

             Summary: Unify slot request timeout handling for streaming and batch tasks
                 Key: FLINK-17542
                 URL: https://issues.apache.org/jira/browse/FLINK-17542
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Coordination
    Affects Versions: 1.11.0
            Reporter: Zhu Zhu
            Assignee: Zhu Zhu
             Fix For: 1.11.0


There are 2 different slot request timeout handling mechanism for batch and streaming tasks.
For streaming tasks, the slot request will fail if it is not fulfilled within slotRequestTimeout.
For batch tasks, the slot request will be checked periodically to see whether it is fulfillable, and only fails if it has been unfulfillable for a certain period(slotRequestTimeout).

With slot marked with whether they will be occupied indefinitely, we can unify these handling. See [FLIP-119|https://cwiki.apache.org/confluence/display/FLINK/FLIP-119+Pipelined+Region+Scheduling#FLIP-119PipelinedRegionScheduling-ExtendedSlotProviderInterface] for more details.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)