osdir.com


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Cannot run example on EMR


Hi Andy,

Can you try setting HADOOP_CLASSPATH=`hadoop classpath` [1]? This is a
common
problem, and we should update the Flink AWS documentation. Can you open a
ticket for that?

Best,
Gary

[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.6/ops/deployment/hadoop.html


On Thu, Aug 30, 2018 at 5:34 PM, Andy M. <ajm2444@xxxxxxxxx> wrote:

> I am trying to launch a Flink cluster on EMR.  I am following directions
> here:
> https://ci.apache.org/projects/flink/flink-docs-
> release-1.6/ops/deployment/aws.html#custom-emr-installation
>
> - I created a cluster with emr-5.16.0 - Hadoop 2.8.4
> - I SSH'd into the master node,
> downloaded flink-1.6.0-bin-hadoop28-scala_2.11.tgz
> - I tried to run HADOOP_CONF_DIR=/etc/hadoop/conf ./bin/flink run -m
> yarn-cluster -yn 1 examples/streaming/WordCount.jar and got the an error:
> Caused by: java.lang.ClassNotFoundException:
> javax.ws.rs.ext.MessageBodyReader
>
> I also get the same error when trying to launch yarn-session.sh
>
> Is anyone able to run 1.6 on EMR and provide me with what I am doing wrong?
>
> Thank you
>