[jira] [Created] (FLINK-11815) Support execution with static resources (Flip-6): E.g. spreading tasks across available set of TMs

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11815) Support execution with static resources (Flip-6): E.g. spreading tasks across available set of TMs

Shang Yuanchun (Jira)
Piotr Nowojski created FLINK-11815:
--------------------------------------

             Summary: Support execution with static resources (Flip-6): E.g. spreading tasks across available set of TMs
                 Key: FLINK-11815
                 URL: https://issues.apache.org/jira/browse/FLINK-11815
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Coordination
    Affects Versions: 1.7.2, 1.6.4
            Reporter: Piotr Nowojski


FLIP-6 code path changed how tasks are distributed across the cluster which is causing problems in some scenarios. This issue intends to improve this.

Known issues:
1. key groups are currently assigned randomly, ignoring their size. Previously larger key groups were evenly spread around the available task managers
2. if task slots are registered before slot request, the code have a tendency to group requests together on the same machine because we are using a LinkedHashMap
3. ???

CC [~[hidden email]]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)