[jira] [Created] (FLINK-16547) Corrent the order to write temporary files in YarnClusterDescriptor#startAppMaster

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-16547) Corrent the order to write temporary files in YarnClusterDescriptor#startAppMaster

Shang Yuanchun (Jira)
Canbin Zheng created FLINK-16547:
------------------------------------

             Summary: Corrent the order to write temporary files in YarnClusterDescriptor#startAppMaster
                 Key: FLINK-16547
                 URL: https://issues.apache.org/jira/browse/FLINK-16547
             Project: Flink
          Issue Type: Improvement
          Components: Deployment / YARN
            Reporter: Canbin Zheng
             Fix For: 1.11.0


Currently, in {{YarnClusterDescriptor#startAppMaster}}, we first write out and upload the Flink Configuration file, then start to write out the JobGraph file and set its name into the Flink Configuration object, the afterward setting is not written into the Flink Configuration file so that it does not take effect in the cluster side.

Since in the client-side we name the JobGraph file with the default value of FileJobGraphRetriever.JOB_GRAPH_FILE_PATH option, the cluster side could succeed in retrieving that file.

This ticket proposes to write out the JobGraph file before the Configuration file to ensure that the setting of FileJobGraphRetriever.JOB_GRAPH_FILE_PATH is delivered to the cluster side.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)