[jira] [Created] (FLINK-13431) NameNode HA configuration was not loaded when running HiveConnector on Yarn

[Shang Yuanchun (Jira)]

Hongtao Zhang created FLINK-13431:
-------------------------------------

             Summary: NameNode HA configuration was not loaded when running HiveConnector on Yarn
                 Key: FLINK-13431
                 URL: https://issues.apache.org/jira/browse/FLINK-13431
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Hive
    Affects Versions: 1.9.0
         Environment: CDH 5.13

Hive 1.2.1

Flink 1.9.0
            Reporter: Hongtao Zhang


Reading the Hive table (version 1.2.1) and write into the hdfs file

 

launch the job from SQL Client

 

 

*StackTrace:*

 
Caused by: java.lang.IllegalArgumentException: [java.net.UnknownHostException|http://java.net.unknownhostexception/]: idc-nn
        at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:374)
        at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:310)
        at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:176)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:668)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:604)
        at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:148)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2598)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2632)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2614)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
        at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:97)
        at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
        at org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:205)
        at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:313)
        at org.apache.flink.batch.connectors.hive.HiveTableInputFormat.createInputSplits(HiveTableInputFormat.java:164)
        at org.apache.flink.batch.connectors.hive.HiveTableInputFormat.createInputSplits(HiveTableInputFormat.java:67)
        at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.<init>(ExecutionJobVertex.java:256)
        ... 22 more
Caused by: [java.net.UnknownHostException|http://java.net.unknownhostexception/]: idc-nn
 



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)