[
https://issues.apache.org/jira/browse/FLINK-937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032221#comment-14032221 ]
Robert Metzger commented on FLINK-937:
--------------------------------------
We currently force users to specify the number of containers they want.
By default, we allocate 512 mb for the TaskManagers, but users should specify a value that suits their needs.
I agree that we should play nice with the others, and I also understand what YARN is made for. I just made the experience that too many times that users don't know how to set the parameters to get the best performance. In addition to that, many users are using the YARN client to run Flink in a Virtual Machine (Hortonworks Sandbox, Cloudera) or on Amazon EMR. In both cases, it is legitimate to allocate all resources.
How about the following: If the user does not specify any arguments, I'll start an "assistant" that asks how many containers the user want and what size they want for it.
The default values for that assistant are a) the maximum number of containers and the largest possible container size. This way, users with exclusive cluster access can just enter "./bin/yarn-client.sh <Enter> <Enter>" to allocate the whole cluster.
> Change the YARN Client to allocate all cluster resources, if no argument given
> ------------------------------------------------------------------------------
>
> Key: FLINK-937
> URL:
https://issues.apache.org/jira/browse/FLINK-937> Project: Flink
> Issue Type: Improvement
> Components: YARN Client
> Reporter: Robert Metzger
> Assignee: Robert Metzger
> Fix For: 0.6-incubating
>
>
> In order to further improve the user experience, I would like to change the YARN client's behavior to allocate as many cluster resources as possible, if the user does not specify differently.
> The majority of users have exclusive access to the cluster.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
Locked
