[jira] [Commented] (FLINK-956) Add a parameter to the YARN command line script that allows to define the amount of MemoryManager memory

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (FLINK-956) Add a parameter to the YARN command line script that allows to define the amount of MemoryManager memory

Shang Yuanchun (Jira)

    [ https://issues.apache.org/jira/browse/FLINK-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14037552#comment-14037552 ]

Robert Metzger commented on FLINK-956:
--------------------------------------

The {{taskmanager.heap.mb}} is the value that the user is passing with {{-tm}}. It is optional (with a default value of 1024).

So this issue boils down to adding a parameter for {{taskmanager.memory.size}}.
The user could also just set the value in the configuration. I'm not 100% convinced if it is really necessary to expose this value to the command line. Somebody who's going to set this is most likely a advanced user that is going to change the configuration anyways (for example for the network buffers)

> Add a parameter to the YARN command line script that allows to define the amount of MemoryManager memory
> --------------------------------------------------------------------------------------------------------
>
>                 Key: FLINK-956
>                 URL: https://issues.apache.org/jira/browse/FLINK-956
>             Project: Flink
>          Issue Type: Improvement
>          Components: YARN Client
>    Affects Versions: 0.6-incubating
>            Reporter: Stephan Ewen
>
> The current parameter specifies the YARN container size.
> It would be nice to have parameters for the JVM heap size {{taskmanager.heap.mb}} and the amount of memory that goes to the memory manager {{taskmanager.memory.size}}. Both should be optional.



--
This message was sent by Atlassian JIRA
(v6.2#6252)