[jira] [Created] (FLINK-13559) Expose YARN Dynamic configuration option flag for flink CLI run

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-13559) Expose YARN Dynamic configuration option flag for flink CLI run

Shang Yuanchun (Jira)
Gyula Fora created FLINK-13559:
----------------------------------

             Summary: Expose YARN Dynamic configuration option flag for flink CLI run
                 Key: FLINK-13559
                 URL: https://issues.apache.org/jira/browse/FLINK-13559
             Project: Flink
          Issue Type: New Feature
          Components: Command Line Client
            Reporter: Gyula Fora


When running flink on yarn, the yarn-session component understand a dynamic option  parameter which allows us to define/overwrite flink conf params from the deploy command.

This is however not accessible when we use the flink run command to start a single job yarn cluster as the command line client fails on this unknown parameter.

Simply adding this extra option to the flink run-options would let flink forward this parameter to the yarn session thus enabling this already existing feature.

In addition I suggest we add the extra "conf" long option name for this parameter:

flink run {{-m yarn-cluster}} --conf key=value ...
or
flink run {{-m yarn-cluster}} --Dkey=value ...



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)