【发布时间】:2021-10-25 21:24:43
【问题描述】:
我想使用kafka-python中的KafkaConsumer来消费一个主题中的前N条消息:
from kafka import KafkaConsumer as kc
import json
bootstrap_servers = ['xx.xxx.xx.xxx:9092']
topic_name = 'my_topic_name'
consumer = kc(topic_name, group_id='group1', bootstrap_servers=bootstrap_servers,
auto_offset_reset='earliest', auto_commit_interval_ms=1000,
enable_auto_commit=True,
value_deserializer=lambda x: json.loads(x.decode('utf-8')))
count = 0
consumer.seek_to_beginning((topic_name,0))
kjson = []
for msg in consumer:
if count < 10:
count = count + 1
kjson.append(msg.value)
else:
print(json.dumps(kjson, indent=4))
break
consumer.seek_to_beginning((topic_name,0)) 这一行给了我上述错误。 documentation 指定:
seek_to_beginning(*partitions)[source]
Seek to the oldest available offset for partitions.
Parameters: *partitions – Optionally provide specific TopicPartitions, otherwise default to all assigned partitions.
Raises: AssertionError – If any partition is not currently assigned, or if no partitions are assigned.
本主题共有 32 个分区(索引从 0 到 31)。从头开始的正确语法是什么?
【问题讨论】:
标签: python apache-kafka kafka-python