[jira] [Created] (FLINK-17729) Make mandatory to have lib/, plugin/ and dist in yarn.provided.lib.dirs

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-17729) Make mandatory to have lib/, plugin/ and dist in yarn.provided.lib.dirs

Shang Yuanchun (Jira)
Kostas Kloudas created FLINK-17729:
--------------------------------------

             Summary: Make mandatory to have lib/, plugin/ and dist in yarn.provided.lib.dirs
                 Key: FLINK-17729
                 URL: https://issues.apache.org/jira/browse/FLINK-17729
             Project: Flink
          Issue Type: Sub-task
          Components: Client / Job Submission, Deployment / YARN
    Affects Versions: 1.11.0
            Reporter: Kostas Kloudas
            Assignee: Kostas Kloudas
             Fix For: 1.11.0


This will make mandatory for users of the "yarn.provided.lib.dirs" to also include the  lib/, plugin/ and flink-dist jar. If these are not included in the shared resources, then the feature cannot be used and all the dependencies of an application are expected to be shipped from the client (as it was the previous behaviour). If they are provided, then these are going to be used and NOT what the user may have locally (e.g. different flink or log4j versions).

The reason for this requirement is to avoid unpleasant surprises with classloading issues.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)