【问题标题】:Kafka Spout ERROR卡夫卡喷口错误
【发布时间】:2016-09-06 09:22:51
【问题描述】:

大家好,希望你们做得好! 请帮我解决这个错误,我什么都不懂 我正在使用storm和kafka在hortonworks沙箱上进行实时处理,当我部署拓扑并与Kafka生产者一起发送数据时,我可以使用Kafka控制台消费者读取它,但是我的storm UI上出现了这个错误!

java.lang.NoSuchMethodError: kafka.javaapi.consumer.SimpleConsumer.<init>(Ljava/lang/String;IIILjava/lang/String;Ljava/lang/String;)V at storm.kafka.DynamicPartitionConnections.register(DynamicPartit

当我检查日志时,我得到了这个

2016-05-11 05:55:47.707 b.s.util [ERROR] Async loop died!
java.lang.NoSuchMethodError: kafka.javaapi.consumer.SimpleConsumer.<init>(Ljava/lang/String;IIILjava/lang/String;Ljava/lang/String;)V
    at storm.kafka.DynamicPartitionConnections.register(DynamicPartitionConnections.java:60) ~[stormjar.jar:?]
    at storm.kafka.PartitionManager.<init>(PartitionManager.java:66) ~[stormjar.jar:?]
    at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:98) ~[stormjar.jar:?]
    at storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:69) ~[stormjar.jar:?]
    at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:138) ~[stormjar.jar:?]
    at backtype.storm.daemon.executor$fn__7177$fn__7192$fn__7221.invoke(executor.clj:596) ~[storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at backtype.storm.util$async_loop$fn__544.invoke(util.clj:475) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
    at java.lang.Thread.run(Thread.java:745) [?:1.7.0_95]
2016-05-11 05:55:47.713 b.s.d.executor [ERROR] 
java.lang.NoSuchMethodError: kafka.javaapi.consumer.SimpleConsumer.<init>(Ljava/lang/String;IIILjava/lang/String;Ljava/lang/String;)V
    at storm.kafka.DynamicPartitionConnections.register(DynamicPartitionConnections.java:60) ~[stormjar.jar:?]
    at storm.kafka.PartitionManager.<init>(PartitionManager.java:66) ~[stormjar.jar:?]
    at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:98) ~[stormjar.jar:?]
    at storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:69) ~[stormjar.jar:?]
    at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:138) ~[stormjar.jar:?]
    at backtype.storm.daemon.executor$fn__7177$fn__7192$fn__7221.invoke(executor.clj:596) ~[storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at backtype.storm.util$async_loop$fn__544.invoke(util.clj:475) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
    at java.lang.Thread.run(Thread.java:745) [?:1.7.0_95]
2016-05-11 05:55:47.749 b.s.util [ERROR] Halting process: ("Worker died")
java.lang.RuntimeException: ("Worker died")
    at backtype.storm.util$exit_process_BANG_.doInvoke(util.clj:332) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.6.0.jar:?]
    at backtype.storm.daemon.worker$fn__7818$fn__7819.invoke(worker.clj:636) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at backtype.storm.daemon.executor$mk_executor_data$fn__7078$fn__7079.invoke(executor.clj:256) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at backtype.storm.util$async_loop$fn__544.invoke(util.clj:485) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
    at java.lang.Thread.run(Thread.java:745) [?:1.7.0_95]

2016-05-11 05:55:59.156 b.s.util [ERROR] Async loop died!
java.lang.NoSuchMethodError: kafka.javaapi.consumer.SimpleConsumer.<init>(Ljava/lang/String;IIILjava/lang/String;Ljava/lang/String;)V
    at storm.kafka.DynamicPartitionConnections.register(DynamicPartitionConnections.java:60) ~[stormjar.jar:?]
    at storm.kafka.PartitionManager.<init>(PartitionManager.java:66) ~[stormjar.jar:?]
    at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:98) ~[stormjar.jar:?]
    at storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:69) ~[stormjar.jar:?]
    at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:138) ~[stormjar.jar:?]
    at backtype.storm.daemon.executor$fn__7177$fn__7192$fn__7221.invoke(executor.clj:596) ~[storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at backtype.storm.util$async_loop$fn__544.invoke(util.clj:475) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
    at java.lang.Thread.run(Thread.java:745) [?:1.7.0_95]
2016-05-11 05:55:59.162 b.s.d.executor [ERROR] 
java.lang.NoSuchMethodError: kafka.javaapi.consumer.SimpleConsumer.<init>(Ljava/lang/String;IIILjava/lang/String;Ljava/lang/String;)V
    at storm.kafka.DynamicPartitionConnections.register(DynamicPartitionConnections.java:60) ~[stormjar.jar:?]
    at storm.kafka.PartitionManager.<init>(PartitionManager.java:66) ~[stormjar.jar:?]
    at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:98) ~[stormjar.jar:?]
    at storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:69) ~[stormjar.jar:?]
    at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:138) ~[stormjar.jar:?]
    at backtype.storm.daemon.executor$fn__7177$fn__7192$fn__7221.invoke(executor.clj:596) ~[storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at backtype.storm.util$async_loop$fn__544.invoke(util.clj:475) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
    at java.lang.Thread.run(Thread.java:745) [?:1.7.0_95]
2016-05-11 05:55:59.195 b.s.util [ERROR] Halting process: ("Worker died")
java.lang.RuntimeException: ("Worker died")
    at backtype.storm.util$exit_process_BANG_.doInvoke(util.clj:332) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.6.0.jar:?]
    at backtype.storm.daemon.worker$fn__7818$fn__7819.invoke(worker.clj:636) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at backtype.storm.daemon.executor$mk_executor_data$fn__7078$fn__7079.invoke(executor.clj:256) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at backtype.storm.util$async_loop$fn__544.invoke(util.clj:485) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
    at java.lang.Thread.run(Thread.java:745) [?:1.7.0_95]

感谢大家的帮助

【问题讨论】:

  • 你使用的是什么版本的 Kafka 和 Storm?

标签: java logging apache-kafka apache-storm hortonworks-data-platform


【解决方案1】:

在 pom.xml 中检查堆栈版本和 kafka 版本。出现这种情况是因为版本不匹配。

【讨论】:

    猜你喜欢
    • 2017-07-07
    • 1970-01-01
    • 2020-03-15
    • 2018-08-15
    • 2018-12-04
    • 1970-01-01
    • 1970-01-01
    • 2019-04-11
    • 1970-01-01
    相关资源
    最近更新 更多