osdir.com


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Getting NoMethod found error while running job on flink 1.6.1


The cause cannot be that flink-metrics-core is not on the classpath as in that case you'd get a ClassNotFoundError.

This is a version conflict, either caused by your fat jar bundling an older version of flink-metrics-core but a newer version of the kafka connector, or you upgrade your application correctly but the cluster is actually still running an older version.

Please check your dependencies and build setup.

On 11.10.2018 08:05, Chandu Kempaiah wrote:
Flink is running as standalone cluster in High Availability mode, My application jar is a fat jar which has all the necessary dependencies included. 

I will check once again and verify by adding the flink-metrics-core to the classpath.

Thanks
Chandu

On Wed, Oct 10, 2018 at 8:38 PM vino yang <yanghua1127@xxxxxxxxx> wrote:
Hi Chandu,

What mode does your Flink run in? 
In addition, can you check if the flink-metrics-core is included in the classpath of the Flink runtime environment?

Thanks, vino.

Chandu Kempaiah <chandu.kempaiah@xxxxxxxxxxxxxx> 于2018年10月11日周四 上午9:51写道:

Hello,

I am have a job that reads messages from kafka, processes them and writes back to kafka, this jobs works fine on flink 1.3.2. I upgraded cluster to 1.6.1 but now see below error. Has any one faced similar issue?

I have updated all the dependencies to use 
<flink.version>1.6.1</flink.version>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-kafka-0.10_${scala.version}</artifactId>
    <version>${flink.version}</version>
</dependency>

java.lang.NoSuchMethodError: org.apache.flink.metrics.MetricGroup.addGroup(Ljava/lang/String;Ljava/lang/String;)Lorg/apache/flink/metrics/MetricGroup;
	at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.registerOffsetMetrics(AbstractFetcher.java:622)
	at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.<init>(AbstractFetcher.java:200)
	at org.apache.flink.streaming.connectors.kafka.internal.Kafka09Fetcher.<init>(Kafka09Fetcher.java:91)
	at org.apache.flink.streaming.connectors.kafka.internal.Kafka010Fetcher.<init>(Kafka010Fetcher.java:64)
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer010.createFetcher(FlinkKafkaConsumer010.java:209)
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:647)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:87)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:56)
	at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:99)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
	at java.lang.Thread.run(Thread.java:748)


Thanks
Chandu