Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CDC data inconsistency after injection network partition between all cdc and all kafka #11910

Open
Lily2025 opened this issue Dec 19, 2024 · 1 comment
Assignees
Labels
affects-8.1 This bug affects the 8.1.x(LTS) versions. area/ticdc Issues or PRs related to TiCDC. impact/inconsistency incorrect/inconsistency/inconsistent may-affects-5.4 may-affects-6.1 may-affects-6.5 may-affects-7.1 may-affects-7.5 may-affects-8.5 severity/critical type/bug The issue is confirmed as a bug.

Comments

@Lily2025
Copy link

Lily2025 commented Dec 19, 2024

What did you do?

1、downstream:kafka
2、run sysbench and cdc_boundary
3、inject network partition between all cdc and all kafka lasts for 10mins
4、recover fault
Image

What did you expect to see?

data consistency

What did you see instead?

CDC data inconsistency when injection some fault
�[3A�[JComparing the table data of sysbench_64_7000w.sbtest39 ... failure


Progress [============================================================>] 100% 0/0
�[1A�[JProgress [============================================================>] 100% 0/0
The data of sysbench_64_7000w.sbtest39 is not equal
The rest of tables are all equal.

Versions of the cluster

./cdc version
Release Version: v8.1.2
Git Commit Hash: 0c88977
Git Branch: HEAD
UTC Build Time: 2024-12-17 04:31:18
Go Version: go version go1.21.13 linux/amd64
Failpoint Build: false
2024-12-19T11:07:37.891+0800

current status of DM cluster (execute query-status <task-name> in dmctl)

No response

@Lily2025 Lily2025 added area/dm Issues or PRs related to DM. type/bug The issue is confirmed as a bug. labels Dec 19, 2024
@Lily2025
Copy link
Author

/severity critical
/assign hicqu

@D3Hunter D3Hunter added area/ticdc Issues or PRs related to TiCDC. and removed area/dm Issues or PRs related to DM. labels Dec 20, 2024
@Lily2025 Lily2025 changed the title CDC data inconsistency when injection some fault CDC data inconsistency after injection network partition between all cdc and all kafka Dec 23, 2024
@jebter jebter added impact/inconsistency incorrect/inconsistency/inconsistent affects-8.1 This bug affects the 8.1.x(LTS) versions. labels Dec 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects-8.1 This bug affects the 8.1.x(LTS) versions. area/ticdc Issues or PRs related to TiCDC. impact/inconsistency incorrect/inconsistency/inconsistent may-affects-5.4 may-affects-6.1 may-affects-6.5 may-affects-7.1 may-affects-7.5 may-affects-8.5 severity/critical type/bug The issue is confirmed as a bug.
Projects
None yet
Development

No branches or pull requests

4 participants