[jira] [Created] (FLINK-21982) jobs should use client org.apache.hadoop.config on yarn

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-21982) jobs should use client org.apache.hadoop.config on yarn

Shang Yuanchun (Jira)
Bo Cui created FLINK-21982:
------------------------------

             Summary: jobs should use client org.apache.hadoop.config on yarn
                 Key: FLINK-21982
                 URL: https://issues.apache.org/jira/browse/FLINK-21982
             Project: Flink
          Issue Type: Bug
          Components: Deployment / YARN
    Affects Versions: 1.13.0
            Reporter: Bo Cui


currently, jobs use the Yarn server configuration during execution.
i think we should submit the configuration to the HDFS, like MR job.xml...etc
and container fetches the job.xml and creates a soft link(hdfs-site core-site yarn-site) during container initializes
and then the configuration can obtain these resources through classLoader.getResource(String) during configuration initializes



--
This message was sent by Atlassian Jira
(v8.3.4#803005)