[jira] [Created] (FLINK-8431) Allow to specify # GPUs for TaskManager in Mesos

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-8431) Allow to specify # GPUs for TaskManager in Mesos

Shang Yuanchun (Jira)
Dongwon Kim created FLINK-8431:
----------------------------------

             Summary: Allow to specify # GPUs for TaskManager in Mesos
                 Key: FLINK-8431
                 URL: https://issues.apache.org/jira/browse/FLINK-8431
             Project: Flink
          Issue Type: Improvement
          Components: Cluster Management, Mesos
            Reporter: Dongwon Kim
            Priority: Minor


Mesos provides first-class support for Nvidia GPUs [1], but Flink does not exploit it when scheduling TaskManagers. If Mesos agents are configured to isolate GPUs as shown in [2], TaskManagers that do not specify to use GPUs cannot see GPUs at all.

We, therefore, need to introduce a new configuration property named "mesos.resourcemanager.tasks.gpus" to allow users to specify # of GPUs for each TaskManager process in Mesos.

[1] http://mesos.apache.org/documentation/latest/gpu-support/
[2] http://mesos.apache.org/documentation/latest/gpu-support/#agent-flags



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)