【问题标题】:spring-boot embedded kafka issue : I am getting Invalid receive (size = 369296129 larger than 104857600)spring-boot 嵌入式 kafka 问题:我收到无效接收(大小 = 369296129 大于 104857600)
【发布时间】:2021-06-12 09:32:20
【问题描述】:
  1. 我正在使用 Spring Boot、嵌入式 kafka 和 temporal 编写集成测试用例。我正在尝试发送有关 kafka 主题的消息。
@SpringBootTest(classes = Application.class)
@RunWith(SpringJUnit4ClassRunner.class)
@ActiveProfiles("test")
@DirtiesContext
@EmbeddedKafka(
        partitions = 5,
        controlledShutdown = true,
        brokerProperties = {
                "listeners=PLAINTEXT://localhost:9092",
                "port=9092"
        })
public class OutboundFlowIT {

    private final Logger logger = LoggerFactory.getLogger(OutboundFlowIT.class);

    private TestWorkflowEnvironment testEnv;

    private Worker worker;

    private WorkflowClient workflowClient;

    @Autowired
    private ActivityService activityService;

    @Autowired
    private EventSender sender;

    @Before
    public void setUp(){
         // some setup code.
    }

    @Test
    public void processOutboundFinancialMessage_shouldTriggerAllSteps_WhenOK() throws IOException,InterruptedException {
        // logic for sending message to intended topic.
    }
  1. 但我遇到了错误。
org.apache.kafka.common.network.InvalidReceiveException: Invalid receive (size = 369296129 larger than 104857600)
    at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:105) ~[kafka-clients-2.5.1.jar:na]
    at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:447) ~[kafka-clients-2.5.1.jar:na]
    at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:397) ~[kafka-clients-2.5.1.jar:na]
    at org.apache.kafka.common.network.Selector.attemptRead(Selector.java:678) ~[kafka-clients-2.5.1.jar:na]
    at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:580) ~[kafka-clients-2.5.1.jar:na]
    at org.apache.kafka.common.network.Selector.poll(Selector.java:485) ~[kafka-clients-2.5.1.jar:na]
    at kafka.network.Processor.poll(SocketServer.scala:861) ~[kafka_2.12-2.5.1.jar:na]
    at kafka.network.Processor.run(SocketServer.scala:760) ~[kafka_2.12-2.5.1.jar:na]
  1. 我还在 kafka.properties 中添加了以下配置,但我遇到了与上述相同的问题。
spring.kafka.producer.properties.max.request.size=569296129
spring.kafka.consumer.properties.max.partition.fetch.bytes=369296129

我是 kafka 新手,请帮助我。

【问题讨论】:

    标签: integration-testing embedded-kafka


    【解决方案1】:

    如何将消息发送到 kafka 代理?您应该使用 kafka 协议而不是使用 HTTP 请求,类似于问题说明这是错误来自

    【讨论】:

      猜你喜欢
      • 2018-08-28
      • 1970-01-01
      • 1970-01-01
      • 2019-09-15
      • 2013-11-23
      • 2018-10-09
      • 2019-02-02
      • 1970-01-01
      • 1970-01-01
      相关资源
      最近更新 更多