[jira] [Created] (FLINK-12362) Add container number config option for Flink on yarn job cluster mode

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-12362) Add container number config option for Flink on yarn job cluster mode

Shang Yuanchun (Jira)
vinoyang created FLINK-12362:
--------------------------------

             Summary: Add container number config option for Flink on yarn job cluster mode
                 Key: FLINK-12362
                 URL: https://issues.apache.org/jira/browse/FLINK-12362
             Project: Flink
          Issue Type: Bug
          Components: Deployment / YARN
            Reporter: vinoyang
            Assignee: vinoyang


Recently, the {{-n}} config option has been removed from the document, the commit is here: [https://github.com/apache/flink/commit/60507b8baf5fba999b7c2c45c150914f38f5ce38#diff-8ae07fac4c1f4137fc1ef062aef70115L100]

I can understand that maybe this option is useless for Flink session. But for job cluster mode, remove this option would confuse the users:
 * the {{-n}} has been deprecated and replaced with {{-p}}?
 * {{-p}} means the job level parallelism, but if users want to set a single operator's parallelism? how to calculate the number of containers
 * the {{-n}} option still exists in {{FlinkYarnSessionCli}}
 * we have customized the source code which broken the rule: one container one slot, so the {{-n}} is still useful

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)