[jira] [Created] (FLINK-18551) Don't need to download flink-conf.yaml when launching taskmanager on Yarn mode

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-18551) Don't need to download flink-conf.yaml when launching taskmanager on Yarn mode

Shang Yuanchun (Jira)
Yumeng Zhang created FLINK-18551:
------------------------------------

             Summary: Don't need to download flink-conf.yaml when launching taskmanager on Yarn mode
                 Key: FLINK-18551
                 URL: https://issues.apache.org/jira/browse/FLINK-18551
             Project: Flink
          Issue Type: Improvement
    Affects Versions: 1.11.0, 1.10.1
            Reporter: Yumeng Zhang


In current flink version, launching a taskmanager on Yarn will follow these steps:
1. download flink-conf.yaml file to the local working directory
2. get Configuration object by reading local flink-conf.yaml file
We could reduce the IO operation by setting flinkConfig to container env when createTaskExecutorContext in jobmanager side and getting Configuration object by system env in taskmanager side. This way we don't need to download flink-conf.yaml when launching taskmanager on Yarn and could accelerate the start process a little bit.




--
This message was sent by Atlassian Jira
(v8.3.4#803005)