[jira] [Commented] (FLINK-937) Change the YARN Client to allocate all cluster resources, if no argument given

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (FLINK-937) Change the YARN Client to allocate all cluster resources, if no argument given

Shang Yuanchun (Jira)

    [ https://issues.apache.org/jira/browse/FLINK-937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031853#comment-14031853 ]

Fabian Hueske commented on FLINK-937:
-------------------------------------

Taking all resources by default doesn't sound like a good idea to me. Sharing resources is actually what resource manager and schedulers like YARN are made for. IMO, the default settings should make Flink play nice with other systems.
I'd rather follow a conservative strategy here and only allocate resources for one JM and one TM. I assume that every user who wants to run Flink in a distributed setup needs to adapt some configuration parameter anyways.


> Change the YARN Client to allocate all cluster resources, if no argument given
> ------------------------------------------------------------------------------
>
>                 Key: FLINK-937
>                 URL: https://issues.apache.org/jira/browse/FLINK-937
>             Project: Flink
>          Issue Type: Improvement
>          Components: YARN Client
>            Reporter: Robert Metzger
>            Assignee: Robert Metzger
>             Fix For: 0.6-incubating
>
>
> In order to further improve the user experience, I would like to change the YARN client's behavior to allocate as many cluster resources as possible, if the user does not specify differently.
> The majority of users have exclusive access to the cluster.



--
This message was sent by Atlassian JIRA
(v6.2#6252)