Apache Kafka Producer Program 正在抛出 kafka.common.KafkaException、java.nio.channels.ClosedChannelException 和 kafka.common。如何解决？

Question

kafka.common.KafkaException: fetching topic metadata for topics [Set(tweets)] from broker [ArrayBuffer(id:0,host:localhost,port:9092)] failed
at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:72)
at kafka.producer.BrokerPartitionInfo.updateInfo(BrokerPartitionInfo.scala:82)
at kafka.producer.async.DefaultEventHandler$$anonfun$handle$2.apply$mcV$sp(DefaultEventHandler.scala:78)
at kafka.utils.Utils$.swallow(Utils.scala:172)
at kafka.utils.Logging$class.swallowError(Logging.scala:106)
at kafka.utils.Utils$.swallowError(Utils.scala:45)
at kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:78)
at kafka.producer.Producer.send(Producer.scala:77)
at kafka.javaapi.producer.Producer.send(Producer.scala:33)
at com.aail.kafka.KafkaConnection.r(KafkaConnection.java:141)
at com.aail.kafka.Postgresconnection.main(Postgresconnection.java:40)
Caused by: java.nio.channels.ClosedChannelException
at kafka.network.BlockingChannel.send(BlockingChannel.scala:100)
at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:73)
at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:72)
at kafka.producer.SyncProducer.send(SyncProducer.scala:113)
at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:58)
... 10 more

[2016-02-17 09:02:36,876] 错误无法发送对相关 ID 在 [0,32] 中的主题推文的请求

如何解决这个问题，任何帮助将不胜感激

提前致谢

Answer 1

我会按照以下几点来调查您可能已经检查过的内容。

检查控制台生产者和控制台消费者是否按预期工作。以下是启动Zookeeper和Kafka服务器并创建主题后的命令。

    bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
    bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic test --from-beginning

检查advertised.host.name 是否在server.properties 文件中设置为正确的值

请让我知道这些是否有助于解决问题，或者您是否能够通过其他一些更改来解决问题。