[jira] [Created] (FLINK-17372) SlotManager should expose total required resources

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-17372) SlotManager should expose total required resources

Shang Yuanchun (Jira)
Till Rohrmann created FLINK-17372:
-------------------------------------

             Summary: SlotManager should expose total required resources
                 Key: FLINK-17372
                 URL: https://issues.apache.org/jira/browse/FLINK-17372
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Coordination
    Affects Versions: 1.10.1, 1.11.0
            Reporter: Till Rohrmann
             Fix For: 1.11.0


Currently, the {{SlotManager}} exposes the set of required resources which have not been fulfilled via {{SlotManager.getRequiredResources}}. The idea of this function is to allow the {{ResourceManager}} to decide whether new pods/containers need to be started or not.

The problem is that once a resource has been registered at the {{SlotManager}} it will decrease the set of required resources. If now a pod/container fails, then the {{ResourceManager}} won't know whether it needs to restart the container or not.

In order to simplify the interaction, I propose to let the {{SlotManager}} announce all of its required resources (pending + registered resources). That way the {{ResourceManager}} only needs to compare the set of required resources with the set of pending and allocated containers/pods.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)