[jira] [Created] (FLINK-16595) Support extra hadoop filesystem URLs for which to request delegation tokens

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-16595) Support extra hadoop filesystem URLs for which to request delegation tokens

Shang Yuanchun (Jira)
fa zheng created FLINK-16595:
--------------------------------

             Summary: Support extra hadoop filesystem URLs for which to request delegation tokens
                 Key: FLINK-16595
                 URL: https://issues.apache.org/jira/browse/FLINK-16595
             Project: Flink
          Issue Type: Improvement
          Components: Deployment / YARN
    Affects Versions: 1.10.0
            Reporter: fa zheng
             Fix For: 1.11.0


When the cluster has multiple nameservices, the client only can obtain the tokens of default nameservice. We should add an configuration in YarnConfigOptions to obtain all nameservices refer to spark. [yarn-specific-kerberos-configuration|https://spark.apache.org/docs/latest/running-on-yarn.html#yarn-specific-kerberos-configuration].

I encountered this problem when the directory of yarn logs is in another nameservice.  It will lead a long waiting for application to run and the log can not  be aggregated finally.




--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Reply | Threaded
Open this post in threaded view
|

Re: [jira] [Created] (FLINK-16595) Support extra hadoop filesystem URLs for which to request delegation tokens

Husky Zeng
Hi all ,

I hava solved this problem in my production environment, and I would like to
do something for the community, could you assign this issue to me?





--
Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/