I tried to run an example program to the first time in FLINK and I got this error. I have already started FLINK with bin/start-local.sh. Can someone please help?
21:01:19,898 WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable org.apache.flink.client.program.ProgramInvocationException: Could not build up connection to JobManager. at org.apache.flink.client.program.Client.run(Client.java:327) at org.apache.flink.client.program.Client.run(Client.java:306) at org.apache.flink.client.program.Client.run(Client.java:300) at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:55) at org.apache.flink.examples.java.wordcount.WordCount.main(WordCount.java:82) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:437) at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:353) at org.apache.flink.client.program.Client.run(Client.java:250) at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:371) at org.apache.flink.client.CliFrontend.run(CliFrontend.java:344) at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1087) at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1114) Caused by: java.io.IOException: JobManager at akka.tcp://flink@10.178.49.22:6123/user/jobmanager not reachable. Please make sure that the JobManager is running and its port is reachable. at org.apache.flink.runtime.jobmanager.JobManager$.getJobManagerRemoteReference(JobManager.scala:897) at org.apache.flink.runtime.client.JobClient$.createJobClient(JobClient.scala:151) at org.apache.flink.runtime.client.JobClient$.createJobClientFromConfig(JobClient.scala:142) at org.apache.flink.runtime.client.JobClient$.startActorSystemAndActor(JobClient.scala:125) at org.apache.flink.runtime.client.JobClient.startActorSystemAndActor(JobClient.scala) at org.apache.flink.client.program.Client.run(Client.java:322) ... 15 more Caused by: java.util.concurrent.TimeoutException: Futures timed out after [10000 milliseconds] at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:219) at scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223) at scala.concurrent.Await$$anonfun$result$1.apply(package.scala:107) at scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53) at scala.concurrent.Await$.result(package.scala:107) at org.apache.flink.runtime.jobmanager.JobManager$.getJobManagerRemoteReference(JobManager.scala:893) ... 20 more The exception above occurred while trying to run your command. |
Hi,
can you have a look at the jobmanager log file in the "log/" directory? I suspect there was an issue when you've started the JobManager. On Sun, Feb 22, 2015 at 4:35 PM, Dulaj Viduranga <[hidden email]> wrote: > I tried to run an example program to the first time in FLINK and I got > this error. I have already started FLINK with bin/start-local.sh. Can > someone please help? > > 21:01:19,898 WARN org.apache.hadoop.util.NativeCodeLoader > - Unable to load native-hadoop library for your platform... using > builtin-java classes where applicable > org.apache.flink.client.program.ProgramInvocationException: Could not > build up connection to JobManager. > at org.apache.flink.client.program.Client.run(Client.java:327) > at org.apache.flink.client.program.Client.run(Client.java:306) > at org.apache.flink.client.program.Client.run(Client.java:300) > at > org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:55) > at > org.apache.flink.examples.java.wordcount.WordCount.main(WordCount.java:82) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:483) > at > org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:437) > at > org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:353) > at org.apache.flink.client.program.Client.run(Client.java:250) > at > org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:371) > at org.apache.flink.client.CliFrontend.run(CliFrontend.java:344) > at > org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1087) > at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1114) > Caused by: java.io.IOException: JobManager at akka.tcp:// > flink@10.178.49.22:6123/user/jobmanager not reachable. Please make sure > that the JobManager is running and its port is reachable. > at > org.apache.flink.runtime.jobmanager.JobManager$.getJobManagerRemoteReference(JobManager.scala:897) > at > org.apache.flink.runtime.client.JobClient$.createJobClient(JobClient.scala:151) > at > org.apache.flink.runtime.client.JobClient$.createJobClientFromConfig(JobClient.scala:142) > at > org.apache.flink.runtime.client.JobClient$.startActorSystemAndActor(JobClient.scala:125) > at > org.apache.flink.runtime.client.JobClient.startActorSystemAndActor(JobClient.scala) > at org.apache.flink.client.program.Client.run(Client.java:322) > ... 15 more > Caused by: java.util.concurrent.TimeoutException: Futures timed out after > [10000 milliseconds] > at > scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:219) > at > scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223) > at > scala.concurrent.Await$$anonfun$result$1.apply(package.scala:107) > at > scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53) > at scala.concurrent.Await$.result(package.scala:107) > at > org.apache.flink.runtime.jobmanager.JobManager$.getJobManagerRemoteReference(JobManager.scala:893) > ... 20 more > > The exception above occurred while trying to run your command. |
I can’t see any problems there. Can you? Do I need hadoop libraries?
20:59:30,832 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManager 20:59:31,255 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started 20:59:31,306 INFO Remoting - Starting remoting 20:59:31,470 INFO Remoting - Remoting started; listening on addresses :[akka.tcp://flink@10.178.49.22:6123] 20:59:31,488 INFO org.apache.flink.runtime.blob.BlobServer - Created BLOB server storage directory /var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/blobStore-c56331a6-b3fc-49dc-ba80-5bddac339faf 20:59:31,496 INFO org.apache.flink.runtime.blob.BlobServer - Started BLOB server at 0.0.0.0:57095 - max concurrent requests: 50 - max backlog: 1000 20:59:31,509 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting embedded TaskManager for JobManager's LOCAL mode execution 20:59:31,515 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManager at akka://flink/user/jobmanager. 20:59:31,517 INFO org.apache.flink.runtime.taskmanager.TaskManager - Using 0.7 of the free heap space for managed memory. 20:59:31,571 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManger web frontend 20:59:31,578 INFO org.apache.flink.runtime.jobmanager.web.WebInfoServer - Setting up web info server, using web-root directoryjar:file:/Users/Vidura/Documents/Development/flink/flink-dist/target/flink-0.9-SNAPSHOT-bin/flink-0.9-SNAPSHOT/lib/flink-runtime-0.9-SNAPSHOT.jar!/web-docs-infoserver. 20:59:31,579 INFO org.apache.flink.runtime.taskmanager.TaskManager - Starting task manager at akka://flink/user/taskmanager. 20:59:31,579 INFO org.apache.flink.runtime.taskmanager.TaskManager - Creating 1 task slot(s). 20:59:31,579 INFO org.apache.flink.runtime.taskmanager.TaskManager - TaskManager connection information 127.0.0.1 (dataPort=57096). 20:59:31,585 INFO org.apache.flink.runtime.taskmanager.TaskManager - Temporary file directory '/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T': total 232 GB, usable 12 GB (5.17% usable) 20:59:31,588 INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager uses directory /var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/flink-io-ba181dfc-e543-49d4-9772-d79327e89c02 for spill files. 20:59:31,980 INFO org.eclipse.jetty.util.log - jetty-8.0.0.M1 20:59:32,020 INFO org.apache.flink.runtime.taskmanager.TaskManager - Profiling of jobs is disabled. 20:59:32,026 INFO org.apache.flink.runtime.taskmanager.TaskManager - Memory usage stats: [HEAP: 522/736/736 MB, NON HEAP: 28/28/-1 MB (used/committed/max)] 20:59:32,040 INFO org.eclipse.jetty.util.log - Started SelectChannelConnector@0.0.0.0:8081 20:59:32,040 INFO org.apache.flink.runtime.jobmanager.web.WebInfoServer - Started web info server for JobManager on null:8081 20:59:32,094 INFO org.apache.flink.runtime.taskmanager.TaskManager - Try to register at master akka.tcp://flink@10.178.49.22:6123/user/jobmanager. 1. Attempt 20:59:32,101 INFO org.apache.flink.runtime.instance.InstanceManager - Registered TaskManager at 127 (akka://flink/user/taskmanager) as 0cf64482e737db81677809ecb94dc53c. Current number of registered hosts is 1. 20:59:32,251 INFO org.apache.flink.runtime.io.network.buffer.NetworkBufferPool - Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768). 20:59:32,253 INFO org.apache.flink.runtime.taskmanager.TaskManager - Determined BLOB server address to be localhost/10.178.49.22:57095. 20:59:32,263 INFO org.apache.flink.runtime.blob.BlobCache - Created BLOB cache storage directory /var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/blobStore-6fc92d7e-141f-4945-9e47-febbe2019f54 > On Feb 22, 2015, at 9:08 PM, Robert Metzger <[hidden email]> wrote: > > Hi, > > can you have a look at the jobmanager log file in the "log/" directory? I > suspect there was an issue when you've started the JobManager. > > On Sun, Feb 22, 2015 at 4:35 PM, Dulaj Viduranga <[hidden email]> > wrote: > >> I tried to run an example program to the first time in FLINK and I got >> this error. I have already started FLINK with bin/start-local.sh. Can >> someone please help? >> >> 21:01:19,898 WARN org.apache.hadoop.util.NativeCodeLoader >> - Unable to load native-hadoop library for your platform... using >> builtin-java classes where applicable >> org.apache.flink.client.program.ProgramInvocationException: Could not >> build up connection to JobManager. >> at org.apache.flink.client.program.Client.run(Client.java:327) >> at org.apache.flink.client.program.Client.run(Client.java:306) >> at org.apache.flink.client.program.Client.run(Client.java:300) >> at >> org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:55) >> at >> org.apache.flink.examples.java.wordcount.WordCount.main(WordCount.java:82) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:483) >> at >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:437) >> at >> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:353) >> at org.apache.flink.client.program.Client.run(Client.java:250) >> at >> org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:371) >> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:344) >> at >> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1087) >> at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1114) >> Caused by: java.io.IOException: JobManager at akka.tcp:// >> flink@10.178.49.22:6123/user/jobmanager not reachable. Please make sure >> that the JobManager is running and its port is reachable. >> at >> org.apache.flink.runtime.jobmanager.JobManager$.getJobManagerRemoteReference(JobManager.scala:897) >> at >> org.apache.flink.runtime.client.JobClient$.createJobClient(JobClient.scala:151) >> at >> org.apache.flink.runtime.client.JobClient$.createJobClientFromConfig(JobClient.scala:142) >> at >> org.apache.flink.runtime.client.JobClient$.startActorSystemAndActor(JobClient.scala:125) >> at >> org.apache.flink.runtime.client.JobClient.startActorSystemAndActor(JobClient.scala) >> at org.apache.flink.client.program.Client.run(Client.java:322) >> ... 15 more >> Caused by: java.util.concurrent.TimeoutException: Futures timed out after >> [10000 milliseconds] >> at >> scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:219) >> at >> scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223) >> at >> scala.concurrent.Await$$anonfun$result$1.apply(package.scala:107) >> at >> scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53) >> at scala.concurrent.Await$.result(package.scala:107) >> at >> org.apache.flink.runtime.jobmanager.JobManager$.getJobManagerRemoteReference(JobManager.scala:893) >> ... 20 more >> >> The exception above occurred while trying to run your command. |
It seams the problem is with running WordCount.jar. I could run KMeans.jar without any problems. May be I’ve passed the arguments incorrect.
bin/flink run ./examples/flink-java-examples-0.9-SNAPSHOT-WordCount.jar file://'pwd'/hemlet.txt file://'pwd'/wordcount-result.txt > On Feb 22, 2015, at 9:12 PM, Dulaj Viduranga <[hidden email]> wrote: > > I can’t see any problems there. Can you? Do I need hadoop libraries? > > > 20:59:30,832 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManager > 20:59:31,255 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started > 20:59:31,306 INFO Remoting - Starting remoting > 20:59:31,470 INFO Remoting - Remoting started; listening on addresses :[akka.tcp://flink@10.178.49.22:6123] > 20:59:31,488 INFO org.apache.flink.runtime.blob.BlobServer - Created BLOB server storage directory /var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/blobStore-c56331a6-b3fc-49dc-ba80-5bddac339faf > 20:59:31,496 INFO org.apache.flink.runtime.blob.BlobServer - Started BLOB server at 0.0.0.0:57095 - max concurrent requests: 50 - max backlog: 1000 > 20:59:31,509 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting embedded TaskManager for JobManager's LOCAL mode execution > 20:59:31,515 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManager at akka://flink/user/jobmanager. > 20:59:31,517 INFO org.apache.flink.runtime.taskmanager.TaskManager - Using 0.7 of the free heap space for managed memory. > 20:59:31,571 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManger web frontend > 20:59:31,578 INFO org.apache.flink.runtime.jobmanager.web.WebInfoServer - Setting up web info server, using web-root directoryjar:file:/Users/Vidura/Documents/Development/flink/flink-dist/target/flink-0.9-SNAPSHOT-bin/flink-0.9-SNAPSHOT/lib/flink-runtime-0.9-SNAPSHOT.jar!/web-docs-infoserver. > 20:59:31,579 INFO org.apache.flink.runtime.taskmanager.TaskManager - Starting task manager at akka://flink/user/taskmanager. > 20:59:31,579 INFO org.apache.flink.runtime.taskmanager.TaskManager - Creating 1 task slot(s). > 20:59:31,579 INFO org.apache.flink.runtime.taskmanager.TaskManager - TaskManager connection information 127.0.0.1 (dataPort=57096). > 20:59:31,585 INFO org.apache.flink.runtime.taskmanager.TaskManager - Temporary file directory '/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T': total 232 GB, usable 12 GB (5.17% usable) > 20:59:31,588 INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager uses directory /var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/flink-io-ba181dfc-e543-49d4-9772-d79327e89c02 for spill files. > 20:59:31,980 INFO org.eclipse.jetty.util.log - jetty-8.0.0.M1 > 20:59:32,020 INFO org.apache.flink.runtime.taskmanager.TaskManager - Profiling of jobs is disabled. > 20:59:32,026 INFO org.apache.flink.runtime.taskmanager.TaskManager - Memory usage stats: [HEAP: 522/736/736 MB, NON HEAP: 28/28/-1 MB (used/committed/max)] > 20:59:32,040 INFO org.eclipse.jetty.util.log - Started SelectChannelConnector@0.0.0.0:8081 > 20:59:32,040 INFO org.apache.flink.runtime.jobmanager.web.WebInfoServer - Started web info server for JobManager on null:8081 > 20:59:32,094 INFO org.apache.flink.runtime.taskmanager.TaskManager - Try to register at master akka.tcp://flink@10.178.49.22:6123/user/jobmanager. 1. Attempt > 20:59:32,101 INFO org.apache.flink.runtime.instance.InstanceManager - Registered TaskManager at 127 (akka://flink/user/taskmanager) as 0cf64482e737db81677809ecb94dc53c. Current number of registered hosts is 1. > 20:59:32,251 INFO org.apache.flink.runtime.io.network.buffer.NetworkBufferPool - Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768). > 20:59:32,253 INFO org.apache.flink.runtime.taskmanager.TaskManager - Determined BLOB server address to be localhost/10.178.49.22:57095. > 20:59:32,263 INFO org.apache.flink.runtime.blob.BlobCache - Created BLOB cache storage directory /var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/blobStore-6fc92d7e-141f-4945-9e47-febbe2019f54 > > >> On Feb 22, 2015, at 9:08 PM, Robert Metzger <[hidden email]> wrote: >> >> Hi, >> >> can you have a look at the jobmanager log file in the "log/" directory? I >> suspect there was an issue when you've started the JobManager. >> >> On Sun, Feb 22, 2015 at 4:35 PM, Dulaj Viduranga <[hidden email]> >> wrote: >> >>> I tried to run an example program to the first time in FLINK and I got >>> this error. I have already started FLINK with bin/start-local.sh. Can >>> someone please help? >>> >>> 21:01:19,898 WARN org.apache.hadoop.util.NativeCodeLoader >>> - Unable to load native-hadoop library for your platform... using >>> builtin-java classes where applicable >>> org.apache.flink.client.program.ProgramInvocationException: Could not >>> build up connection to JobManager. >>> at org.apache.flink.client.program.Client.run(Client.java:327) >>> at org.apache.flink.client.program.Client.run(Client.java:306) >>> at org.apache.flink.client.program.Client.run(Client.java:300) >>> at >>> org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:55) >>> at >>> org.apache.flink.examples.java.wordcount.WordCount.main(WordCount.java:82) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>> at java.lang.reflect.Method.invoke(Method.java:483) >>> at >>> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:437) >>> at >>> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:353) >>> at org.apache.flink.client.program.Client.run(Client.java:250) >>> at >>> org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:371) >>> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:344) >>> at >>> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1087) >>> at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1114) >>> Caused by: java.io.IOException: JobManager at akka.tcp:// >>> flink@10.178.49.22:6123/user/jobmanager not reachable. Please make sure >>> that the JobManager is running and its port is reachable. >>> at >>> org.apache.flink.runtime.jobmanager.JobManager$.getJobManagerRemoteReference(JobManager.scala:897) >>> at >>> org.apache.flink.runtime.client.JobClient$.createJobClient(JobClient.scala:151) >>> at >>> org.apache.flink.runtime.client.JobClient$.createJobClientFromConfig(JobClient.scala:142) >>> at >>> org.apache.flink.runtime.client.JobClient$.startActorSystemAndActor(JobClient.scala:125) >>> at >>> org.apache.flink.runtime.client.JobClient.startActorSystemAndActor(JobClient.scala) >>> at org.apache.flink.client.program.Client.run(Client.java:322) >>> ... 15 more >>> Caused by: java.util.concurrent.TimeoutException: Futures timed out after >>> [10000 milliseconds] >>> at >>> scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:219) >>> at >>> scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223) >>> at >>> scala.concurrent.Await$$anonfun$result$1.apply(package.scala:107) >>> at >>> scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53) >>> at scala.concurrent.Await$.result(package.scala:107) >>> at >>> org.apache.flink.runtime.jobmanager.JobManager$.getJobManagerRemoteReference(JobManager.scala:893) >>> ... 20 more >>> >>> The exception above occurred while trying to run your command. > |
Free forum by Nabble | Edit this page |