Till Rohrmann created FLINK-17372:
-------------------------------------
Summary: SlotManager should expose total required resources
Key: FLINK-17372
URL:
https://issues.apache.org/jira/browse/FLINK-17372 Project: Flink
Issue Type: Improvement
Components: Runtime / Coordination
Affects Versions: 1.10.1, 1.11.0
Reporter: Till Rohrmann
Fix For: 1.11.0
Currently, the {{SlotManager}} exposes the set of required resources which have not been fulfilled via {{SlotManager.getRequiredResources}}. The idea of this function is to allow the {{ResourceManager}} to decide whether new pods/containers need to be started or not.
The problem is that once a resource has been registered at the {{SlotManager}} it will decrease the set of required resources. If now a pod/container fails, then the {{ResourceManager}} won't know whether it needs to restart the container or not.
In order to simplify the interaction, I propose to let the {{SlotManager}} announce all of its required resources (pending + registered resources). That way the {{ResourceManager}} only needs to compare the set of required resources with the set of pending and allocated containers/pods.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)