[jira] [Created] (FLINK-16734) Remove ClusterSpecification

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-16734) Remove ClusterSpecification

Shang Yuanchun (Jira)
Xintong Song created FLINK-16734:
------------------------------------

             Summary: Remove ClusterSpecification
                 Key: FLINK-16734
                 URL: https://issues.apache.org/jira/browse/FLINK-16734
             Project: Flink
          Issue Type: Improvement
          Components: Command Line Client
            Reporter: Xintong Song


Currently, {{ClusterSpecification}} has the following three fields.
* masterMemoryMB
* taskManagerMemoryMB
* slotsPerTaskManager

Among the three fields, {{taskManagerMemoryMB}} is only used in {{YarnClusterDescriptor#validateClusterResources}}. It can be replaced by "taskmanager.memory.process.size" in the configuration. Moreover, there are consistency risks for keeping the process memory in two places with different precision (MB vs. MemorySize).

{{masterMemoryMB}} should be the same as {{taskManagerMemoryMB}} after finishing [FLIP-116 Unified Memory Configuration for Job Managers|https://cwiki.apache.org/confluence/display/FLINK/FLIP+116%3A+Unified+Memory+Configuration+for+Job+Managers].

That leaves only {{slotsPerTaskManager}}, which can easily get from the configuration.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)