【问题标题】:Kafka Error fetching offset data. Reason: 1Kafka 获取偏移数据时出错。原因:1
【发布时间】:2023-03-14 00:17:01
【问题描述】:
我正在运行一个使用 kafka 库的 java 程序,并每 1 秒检查一次来自 zookeeper 的消费者组的提交偏移量。
程序运行良好约 2 小时并开始抛出 RuntimeException:
java.lang.RuntimeException: Error fetching offset data. Reason: 1
at com.pinterest.secor.common.KafkaClient.getMessage(KafkaClient.java:127)
at com.pinterest.secor.common.KafkaClient.getCommittedMessage(KafkaClient.java:186)
...
原因 1 是什么?我找不到任何文件或页面来说明这种情况的根本原因。
【问题讨论】:
标签:
java
offset
runtimeexception
kafka-consumer-api
apache-kafka
【解决方案1】:
看看这个,这是kafka.common.ErrorMapping的代码片段:
val UnknownCode : Short = -1
val NoError : Short = 0
val OffsetOutOfRangeCode : Short = 1
val InvalidMessageCode : Short = 2
val UnknownTopicOrPartitionCode : Short = 3
val InvalidFetchSizeCode : Short = 4
val LeaderNotAvailableCode : Short = 5
val NotLeaderForPartitionCode : Short = 6
val RequestTimedOutCode: Short = 7
val BrokerNotAvailableCode: Short = 8
val ReplicaNotAvailableCode: Short = 9
val MessageSizeTooLargeCode: Short = 10
val StaleControllerEpochCode: Short = 11
val OffsetMetadataTooLargeCode: Short = 12
val StaleLeaderEpochCode: Short = 13
val OffsetsLoadInProgressCode: Short = 14
val ConsumerCoordinatorNotAvailableCode: Short = 15
val NotCoordinatorForConsumerCode: Short = 16
val InvalidTopicCode : Short = 17
val MessageSetSizeTooLargeCode: Short = 18
val NotEnoughReplicasCode : Short = 19
val NotEnoughReplicasAfterAppendCode: Short = 20
如您所见,1 表示OffsetOutOfRangeCode。