Hi Andy,
Can you try setting HADOOP_CLASSPATH=`hadoop classpath` [1]? This is a
common
problem, and we should update the Flink AWS documentation. Can you open a
ticket for that?
Best,
Gary
[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.6/ops/deployment/hadoop.htmlOn Thu, Aug 30, 2018 at 5:34 PM, Andy M. <
[hidden email]> wrote:
> I am trying to launch a Flink cluster on EMR. I am following directions
> here:
>
https://ci.apache.org/projects/flink/flink-docs-> release-1.6/ops/deployment/aws.html#custom-emr-installation
>
> - I created a cluster with emr-5.16.0 - Hadoop 2.8.4
> - I SSH'd into the master node,
> downloaded flink-1.6.0-bin-hadoop28-scala_2.11.tgz
> - I tried to run HADOOP_CONF_DIR=/etc/hadoop/conf ./bin/flink run -m
> yarn-cluster -yn 1 examples/streaming/WordCount.jar and got the an error:
> Caused by: java.lang.ClassNotFoundException:
> javax.ws.rs.ext.MessageBodyReader
>
> I also get the same error when trying to launch yarn-session.sh
>
> Is anyone able to run 1.6 on EMR and provide me with what I am doing wrong?
>
> Thank you
>