Xianxun Ye created FLINK-16861:
----------------------------------
Summary: Adding delegation token to the AM container Failed
Key: FLINK-16861
URL:
https://issues.apache.org/jira/browse/FLINK-16861 Project: Flink
Issue Type: Bug
Components: Connectors / Hive
Affects Versions: 1.10.0, 1.9.1
Reporter: Xianxun Ye
This EXP happended When I use hive connector with kerberos auth.
Althrough modify the 'yarn-site.xml' yarn.resourcemanager.principal value to the special principal, I can fix this. But I have to change this value every times by modify yarn-site.xml file, when submit a hive conncetor job. This is not very convenient for dev.
{code:java}
//代码占位符
2020-03-06 22:58:01,778 INFO org.apache.flink.yarn.AbstractYarnClusterDescriptor - Adding delegation token to the AM container..
2020-03-06 22:58:01,781 ERROR org.apache.flink.client.cli.CliFrontend - Error while running the command.
org.apache.flink.client.deployment.ClusterDeploymentException: Could not deploy Yarn job cluster.
at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:82)
at org.apache.flink.client.cli.CliFrontend.runProgram(CliFrontend.java:230)
at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:205)
at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1010)
at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1083)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1754)
at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1083)
Caused by: java.io.IOException: Can't get Master Kerberos principal for use as renewer
at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:116)
at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:100)
at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
at org.apache.flink.yarn.Utils.setTokensFor(Utils.java:269)
at org.apache.flink.yarn.AbstractYarnClusterDescriptor.startAppMaster(AbstractYarnClusterDescriptor.java:929)
at org.apache.flink.yarn.AbstractYarnClusterDescriptor.deployInternal(AbstractYarnClusterDescriptor.java:507)
at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:75)
... 9 more
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Locked
