[jira] [Created] (FLINK-5631) [yarn] Support downloading additional jars from non-HDFS paths

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-5631) [yarn] Support downloading additional jars from non-HDFS paths

Shang Yuanchun (Jira)
Haohui Mai created FLINK-5631:
---------------------------------

             Summary: [yarn] Support downloading additional jars from non-HDFS paths
                 Key: FLINK-5631
                 URL: https://issues.apache.org/jira/browse/FLINK-5631
             Project: Flink
          Issue Type: Bug
            Reporter: Haohui Mai
            Assignee: Haohui Mai


Currently the {{YarnResourceManager}} and {{YarnApplicationMasterRunner}} always register the additional jars using the YARN filesystem object. This is problematic as the paths might require another filesystem.

To support localizing from non-HDFS paths (e.g., s3, http or viewfs), the cleaner approach is to get the filesystem object from the path.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)