[jira] [Commented] (FLINK-937) Change the YARN Client to allocate all cluster resources, if no argument given

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (FLINK-937) Change the YARN Client to allocate all cluster resources, if no argument given

Shang Yuanchun (Jira)

    [ https://issues.apache.org/jira/browse/FLINK-937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033199#comment-14033199 ]

Stephan Ewen commented on FLINK-937:
------------------------------------

We are currently moving to a processing model where not all containers are online at the same time. While that wil help running on YARN in resource constrained environments, I think knowing the number of containers to start with is rather orthogonal.

As far as I know, YARN is going to offer a mechanism where you assign requests to queues (for sub pools). Maybe that is a reasonable way of getting a constrained number of containers.

> Change the YARN Client to allocate all cluster resources, if no argument given
> ------------------------------------------------------------------------------
>
>                 Key: FLINK-937
>                 URL: https://issues.apache.org/jira/browse/FLINK-937
>             Project: Flink
>          Issue Type: Improvement
>          Components: YARN Client
>            Reporter: Robert Metzger
>            Assignee: Robert Metzger
>             Fix For: 0.6-incubating
>
>
> In order to further improve the user experience, I would like to change the YARN client's behavior to allocate as many cluster resources as possible, if the user does not specify differently.
> The majority of users have exclusive access to the cluster.



--
This message was sent by Atlassian JIRA
(v6.2#6252)