[jira] [Created] (FLINK-14106) Make SlotManager pluggable

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-14106) Make SlotManager pluggable

Shang Yuanchun (Jira)
Xintong Song created FLINK-14106:
------------------------------------

             Summary: Make SlotManager pluggable
                 Key: FLINK-14106
                 URL: https://issues.apache.org/jira/browse/FLINK-14106
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Coordination
    Affects Versions: 1.9.0
            Reporter: Xintong Song
             Fix For: 1.10.0


As we are enabling fine grained resource management in 1.10, we can have various resource scheduling strategies. Such strategies generally should make the following three decisions.
 * When to launch new / release existing TMs? (How many TMs)
 * What and how many resources should TMs be started with?
 * How to allocate between slot requests and TM resources?

We may want to make above decisions differently in different scenarios (active/reactive mode, perjob/session mode, etc.). Therefore, we propose to make the scheduling strategies pluggable.

We propose to make the following changes:
 * Make SlotManager an interface, and implements it differently for different strategies strategies.
 * Modify ResourceManager-SlotManager interfaces to cover all the three decisions mentioned above in SlotManager. In particular, SlotManager needs to allocate TM resources instead of slot resources from ResourceActions.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)