Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Canal 1.1.7 无法抽取压缩的binlog至kafka #5350

Open
ZiaZiaZiaZia opened this issue Dec 12, 2024 · 2 comments
Open

Canal 1.1.7 无法抽取压缩的binlog至kafka #5350

ZiaZiaZiaZia opened this issue Dec 12, 2024 · 2 comments

Comments

@ZiaZiaZiaZia
Copy link

Question

服务启动后,可以在日志里看到读取到的mysql binlog名称,position,timestamp等信息,但是ZK的znode没有更新cursor信息,kafka中也没有数据写入。同样的实例配置可以正常抽取非压缩的binlog至kafka。
请问Canal需要做什么额外的解压缩配置吗

@agapple
Copy link
Member

agapple commented Dec 17, 2024

需要提供完整的复现参数,比如mysql的压缩参数,以及对应的binlog文件

@ZiaZiaZiaZia
Copy link
Author

mysql压缩参数为:
set global binlog_transaction_compression=on;
set global binlog_transaction_compression_level_zstd=3;
bin-log.000021.txt

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants