【 TiDB 使用环境】生产环境
【 TiDB 版本】v5.4.0
【TICDC版本】v6.5.8
ticdc下游是阿里云kafka,kafka最大消息大小设置为40MB。
toml文件:
memory-quota = 1073741824
[filter]
rules = [“brt.*”]
cdc启动命令:
tiup cdc cli changefeed create \ –pd=xx \ –sink-uri=“kafka://xxxx:9092/brt_migration?protocol=canal-json&partition-num=1&max-message-bytes=36700160” \ –config=./test.toml \ –changefeed-id=“brt-migration-task”
【遇到的问题:问题现象及影响】
出现报错:
tidb-bot@can1-ti-monitor-prod-001:/home/ubuntu$ tiup cdc cli changefeed list --pd=http://10.10.0.55:2379,http://10.10.101.73:2379,http://10.64.115.36:2379
tiup is checking updates for component cdc …
Starting component cdc: /home/tidb-bot/.tiup/components/cdc/v5.4.0/cdc /home/tidb-bot/.tiup/components/cdc/v5.4.0/cdc cli changefeed list --pd=http://10.10.0.55:2379,http://10.10.101.73:2379,http://10.64.115.36:2379
[
{
“id”: “brt-migration-task”,
“namespace”: “default”,
“summary”: {
“state”: “warning”,
“tso”: 461431755300929576,
“checkpoint”: “2025-10-11 22:40:55.219”,
“error”: {
“time”: “2025-10-12T03:55:42.189820708Z”,
“addr”: “10.10.0.55:8300”,
“code”: “CDC:ErrKafkaAsyncSendMessage”,
“message”: “[CDC:ErrKafkaAsyncSendMessage]kafka async send message failed: kafka: Failed to produce message to topic brt_migration: kafka server: The request included message batch larger than the configured segment size on the server”
}
}
}
]
【资源配置】进入到 TiDB Dashboard -集群信息 (Cluster Info) -主机(Hosts) 截图此页面
【附件:截图/日志/监控】