"Unable to find registrar for hdfs" on Flink cluster

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

"Unable to find registrar for hdfs" on Flink cluster

P. Ramanjaneya Reddy
Hi All,

build jar file from the beam quickstart. while run the jar on Flinkcluster
got below error.?

anybody got this error?
Could you please help how to resolve this?

root1@master:~/NAI/Tools/flink-1.3.0$ *bin/flink run -c
org.apache.beam.examples.WordCount
/home/root1/NAI/Tools/word-count-beam/target/word-count-beam-bundled-0.1.jar
--runner=FlinkRunner
--filesToStage=/home/root1/NAI/Tools/word-count-beam/target/word-count-beam-bundled-0.1.jar
--inputFile=hdfs://master:9000/test/wordcount_input.txt
 --output=hdfs://master:9000/test/wordcount_output919*


This is the output I get:

Caused by: java.lang.IllegalStateException: Unable to find registrar for
hdfs
at
org.apache.beam.sdk.io.FileSystems.getFileSystemInternal(FileSystems.java:447)
at org.apache.beam.sdk.io.FileSystems.matchNewResource(FileSystems.java:517)
at
org.apache.beam.sdk.io.FileBasedSink.convertToFileResourceIfPossible(FileBasedSink.java:204)
at org.apache.beam.sdk.io.TextIO$Write.to(TextIO.java:296)
at org.apache.beam.examples.WordCount.main(WordCount.java:182)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:528)
... 13 more


Thanks & Regards,
Ramanji.
Reply | Threaded
Open this post in threaded view
|

Re: "Unable to find registrar for hdfs" on Flink cluster

Jean-Baptiste Onofré
By the way, this kind of question should go on the user mailing list IMHO.

Thanks
Regards
JB

On 08/29/2017 08:59 AM, P. Ramanjaneya Reddy wrote:

> Hi All,
>
> build jar file from the beam quickstart. while run the jar on Flinkcluster
> got below error.?
>
> anybody got this error?
> Could you please help how to resolve this?
>
> root1@master:~/NAI/Tools/flink-1.3.0$ *bin/flink run -c
> org.apache.beam.examples.WordCount
> /home/root1/NAI/Tools/word-count-beam/target/word-count-beam-bundled-0.1.jar
> --runner=FlinkRunner
> --filesToStage=/home/root1/NAI/Tools/word-count-beam/target/word-count-beam-bundled-0.1.jar
> --inputFile=hdfs://master:9000/test/wordcount_input.txt
>   --output=hdfs://master:9000/test/wordcount_output919*
>
>
> This is the output I get:
>
> Caused by: java.lang.IllegalStateException: Unable to find registrar for
> hdfs
> at
> org.apache.beam.sdk.io.FileSystems.getFileSystemInternal(FileSystems.java:447)
> at org.apache.beam.sdk.io.FileSystems.matchNewResource(FileSystems.java:517)
> at
> org.apache.beam.sdk.io.FileBasedSink.convertToFileResourceIfPossible(FileBasedSink.java:204)
> at org.apache.beam.sdk.io.TextIO$Write.to(TextIO.java:296)
> at org.apache.beam.examples.WordCount.main(WordCount.java:182)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:528)
> ... 13 more
>
>
> Thanks & Regards,
> Ramanji.
>

--
Jean-Baptiste Onofré
[hidden email]
http://blog.nanthrax.net
Talend - http://www.talend.com