[jira] [Created] (FLINK-13127) "--yarnship" doesn't support resource classloading

[Shang Yuanchun (Jira)]

David Moravek created FLINK-13127:
-------------------------------------

             Summary: "--yarnship" doesn't support resource classloading
                 Key: FLINK-13127
                 URL: https://issues.apache.org/jira/browse/FLINK-13127
             Project: Flink
          Issue Type: Bug
          Components: Deployment / YARN
    Affects Versions: 1.8.1
            Reporter: David Moravek


Currently yarnship works as follows:
 * user specifies directory to ship with the job
 * yarn ships it with the container
 * org.apache.flink.yarn.AbstractYarnClusterDescriptor#uploadAndRegisterFiles traverses directory recursively and adds each file to the classpath

This works well for shipping jars, but doesn't work correctly with shipping resources that we want to load using java.lang.ClassLoader#getResource method.

In order to make resource classloading work, we need to register it's directory instead of the file itself (java classpath expects directories or archives).

CLASSPATH="shipped/custom.conf:${CLASSPATH}" needs to become CLASSPATH="shipped:${CLASSPATH}"



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)