[jira] [Created] (FLINK-7928) Extend the filed in ResourceProfile for precisely calculating the resource of a task manager

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-7928) Extend the filed in ResourceProfile for precisely calculating the resource of a task manager

Shang Yuanchun (Jira)
shuai.xu created FLINK-7928:
-------------------------------

             Summary: Extend the filed in ResourceProfile for precisely calculating the resource of a task manager
                 Key: FLINK-7928
                 URL: https://issues.apache.org/jira/browse/FLINK-7928
             Project: Flink
          Issue Type: Improvement
          Components: JobManager, ResourceManager
            Reporter: shuai.xu
            Assignee: shuai.xu


ResourceProfile records all the resource requirements for a slot。It is generated by JobMaster and then passed to ResourceManager with the slot request.
A task in the slot needs three parts of resource:
1. The resource for the operators, this is specified by the ResourceSpec user defined
2. The resource for the operators to communicating with their upstreams. For example, the resource for buffer pools and so on.
3. The resource for the operators to communicating with their downstreams. Same as above.
So ResourceProfile should contain three parts of resource, the first part from ResouceSpec, and the other two part be generated by Job Master.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)