OSDir

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot load user class: org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer01


Getting below error.

Command:  ./bin/flink run ~/workspace/thanos/thanos-stream/target/thanos-stream.jar --port 9000

It works well from IDE and java -jar command.

Cluster configuration: Standalone cluster with JobManager at localhost/127.0.0.1:6123

Using address localhost:6123 to connect to JobManager.

JobManager web interface address http://localhost:8081

Starting execution of program


  .   ____          _            __ _ _

 /\\ / ___'_ __ _ _(_)_ __  __ _ \ \ \ \

( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \

 \\/  ___)| |_)| | | | | || (_| |  ) ) ) )

  '  |____| .__|_| |_|_| |_\__, | / / / /

 =========|_|==============|___/=/_/_/_/

 :: Spring Boot ::        (v2.0.0.RELEASE)


Submitting job with JobID: 0facd9e9170ee455c5f6f921dd5e38e5. Waiting for job completion.

Connected to JobManager at Actor[akka.tcp://flink@localhost:6123/user/jobmanager#-952575443] with leader session id 00000000-0000-0000-0000-000000000000.

05/14/2018 15:57:57 Job execution switched to status RUNNING.

05/14/2018 15:57:57 Source: Custom Source -> Sink: Unnamed(1/1) switched to SCHEDULED 

05/14/2018 15:57:57 Source: Custom Source -> Sink: Unnamed(1/1) switched to DEPLOYING 

05/14/2018 15:57:58 Source: Custom Source -> Sink: Unnamed(1/1) switched to RUNNING 

05/14/2018 15:57:58 Source: Custom Source -> Sink: Unnamed(1/1) switched to FAILED 

org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot load user class: org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer011

ClassLoader info: URL ClassLoader:

    file: '/var/folders/zz/zyxvpxvq6csfxvn_n0000000000000/T/blobStore-c7607b0c-7e6f-4be8-8099-8f60a5a9b715/job_0facd9e9170ee455c5f6f921dd5e38e5/blob_p-d8a4d4e1c5d4ac42dcc216fbfba190c56bcb4336-a3dcf774c0a128afb420bace431065f9' (valid JAR)

Class not resolvable through given classloader.

at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperator(StreamConfig.java:232)

at org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:95)

at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:231)

at org.apache.flink.runtime.taskmanager.Task.run(Task.java:718)

at java.lang.Thread.run(Thread.java:748)


05/14/2018 15:57:58 Job execution switched to status FAILING.

org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot load user class: org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer011

ClassLoader info: URL ClassLoader:

    file: '/var/folders/zz/zyxvpxvq6csfxvn_n0000000000000/T/blobStore-c7607b0c-7e6f-4be8-8099-8f60a5a9b715/job_0facd9e9170ee455c5f6f921dd5e38e5/blob_p-d8a4d4e1c5d4ac42dcc216fbfba190c56bcb4336-a3dcf774c0a128afb420bace431065f9' (valid JAR)

Class not resolvable through given classloader.

at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperator(StreamConfig.java:232)

at org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:95)

at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:231)

at org.apache.flink.runtime.taskmanager.Task.run(Task.java:718)

at java.lang.Thread.run(Thread.java:748)

05/14/2018 15:57:58 Job execution switched to status FAILED.

org.apache.flink.client.program.ProgramInvocationException: The program execution failed: Job execution failed.

at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:492)

at org.apache.flink.client.program.StandaloneClusterClient.submitJob(StandaloneClusterClient.java:105)

at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:456)

at org.apache.flink.streaming.api.environment.StreamContextEnvironment.execute(StreamContextEnvironment.java:66)

at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1501)

at com.ailiens.thanos.streams.LogmanFlinkStream.init(LogmanFlinkStream.java:49)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:369)

at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:312)

at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:135)

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:423)

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1702)

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:583)

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:502)

at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:312)

at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:228)

at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:310)

at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:200)

at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:760)

at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:868)

at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)

at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:752)

at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:388)

at org.springframework.boot.SpringApplication.run(SpringApplication.java:327)

at org.springframework.boot.SpringApplication.run(SpringApplication.java:1246)

at org.springframework.boot.SpringApplication.run(SpringApplication.java:1234)

at com.ailiens.thanos.ThanosApplication.main(ThanosApplication.java:9)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)

at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)

at org.springframework.boot.loader.Launcher.launch(Launcher.java:50)

at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:525)

at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:417)

at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:396)

at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:802)

at org.apache.flink.client.CliFrontend.run(CliFrontend.java:282)

at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1054)

at org.apache.flink.client.CliFrontend$1.call(CliFrontend.java:1101)

at org.apache.flink.client.CliFrontend$1.call(CliFrontend.java:1098)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:422)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1807)

at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)

at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1098)

Caused by: org.apache.flink.runtime.client.JobExecutionException: Job execution failed.

at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$6.apply$mcV$sp(JobManager.scala:897)

at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$6.apply(JobManager.scala:840)

at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$6.apply(JobManager.scala:840)

at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)

at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)

at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)

at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)

at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)

at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)

at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)

at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

Caused by: org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot load user class: org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer011

ClassLoader info: URL ClassLoader:

    file: '/var/folders/zz/zyxvpxvq6csfxvn_n0000000000000/T/blobStore-c7607b0c-7e6f-4be8-8099-8f60a5a9b715/job_0facd9e9170ee455c5f6f921dd5e38e5/blob_p-d8a4d4e1c5d4ac42dcc216fbfba190c56bcb4336-a3dcf774c0a128afb420bace431065f9' (valid JAR)

Class not resolvable through given classloader.

at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperator(StreamConfig.java:232)

at org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:95)

at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:231)

at org.apache.flink.runtime.taskmanager.Task.run(Task.java:718)

at java.lang.Thread.run(Thread.java:748)

No JobSubmissionResult returned, please make sure you called ExecutionEnvironment.execute()



--
Chandresh Pancholi
Senior Software Engineer
Flipkart.com
Contact:08951803660