Huang Xingbo created FLINK-20568:
------------------------------------
Summary: Kerberized YARN per-job on Docker test failed with "Hadoop security with Kerberos is enabled but the login user does not have Kerberos credentials or delegation tokens!"
Key: FLINK-20568
URL:
https://issues.apache.org/jira/browse/FLINK-20568 Project: Flink
Issue Type: Bug
Components: Deployment / YARN
Affects Versions: 1.12.0, 1.11.0, 1.13.0
Reporter: Huang Xingbo
Instance on 1.11 branch
[
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=10780&view=logs&j=08866332-78f7-59e4-4f7e-49a56faa3179&t=3e8647c1-5a28-5917-dd93-bf78594ea994]
{code:java}
2020-12-10T22:38:25.1087443Z The program finished with the following exception:
2020-12-10T22:38:25.1087688Z
2020-12-10T22:38:25.1088094Z org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Could not deploy Yarn job cluster.
2020-12-10T22:38:25.1088717Z at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:302)
2020-12-10T22:38:25.1089321Z at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:198)
2020-12-10T22:38:25.1090233Z at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:149)
2020-12-10T22:38:25.1090749Z at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:699)
2020-12-10T22:38:25.1091233Z at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:232)
2020-12-10T22:38:25.1091705Z at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:916)
2020-12-10T22:38:25.1092225Z at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:992)
2020-12-10T22:38:25.1095464Z at java.security.AccessController.doPrivileged(Native Method)
2020-12-10T22:38:25.1095961Z at javax.security.auth.Subject.doAs(Subject.java:422)
2020-12-10T22:38:25.1096436Z at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1840)
2020-12-10T22:38:25.1097027Z at org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
2020-12-10T22:38:25.1097859Z at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:992)
2020-12-10T22:38:25.1098474Z Caused by: org.apache.flink.client.deployment.ClusterDeploymentException: Could not deploy Yarn job cluster.
2020-12-10T22:38:25.1099065Z at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:431)
2020-12-10T22:38:25.1099674Z at org.apache.flink.client.deployment.executors.AbstractJobClusterExecutor.execute(AbstractJobClusterExecutor.java:70)
2020-12-10T22:38:25.1100918Z at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:1818)
2020-12-10T22:38:25.1101607Z at org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:128)
2020-12-10T22:38:25.1102202Z at org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:76)
2020-12-10T22:38:25.1102840Z at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1700)
2020-12-10T22:38:25.1103467Z at org.apache.flink.streaming.examples.wordcount.WordCount.main(WordCount.java:96)
2020-12-10T22:38:25.1104174Z at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2020-12-10T22:38:25.1104638Z at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2020-12-10T22:38:25.1105174Z at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2020-12-10T22:38:25.1105645Z at java.lang.reflect.Method.invoke(Method.java:498)
2020-12-10T22:38:25.1106119Z at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:288)
2020-12-10T22:38:25.1106495Z ... 11 more
2020-12-10T22:38:25.1106940Z Caused by: java.lang.RuntimeException: Hadoop security with Kerberos is enabled but the login user does not have Kerberos credentials or delegation tokens!
2020-12-10T22:38:25.1107584Z at org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:475)
2020-12-10T22:38:25.1108484Z at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:424)
2020-12-10T22:38:25.1109201Z ... 22 more
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Locked
