[jira] [Created] (FLINK-21480) Respect external resources from resource requirements

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-21480) Respect external resources from resource requirements

Shang Yuanchun (Jira)
Xintong Song created FLINK-21480:
------------------------------------

             Summary: Respect external resources from resource requirements
                 Key: FLINK-21480
                 URL: https://issues.apache.org/jira/browse/FLINK-21480
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Coordination
            Reporter: Xintong Song
            Assignee: Yangze Guo


Currently, K8s/Yarn RM reads external resources from configurations and request workers accordingly. That means, all workers will have the same set of external resources.

With the fine-grained resource management allowing TMs with different resources, and applying a strictly matching between requested and registered slot profiles, we need to make sure:
 * Allocate workers respecting external resources specified in the slot resource requirements.
 * Registered / offered slots should contain the same set of external resources as requested.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)