Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug in TICDC v7.5.4 version related to binary fields #11771

Open
lee1988well opened this issue Nov 18, 2024 · 6 comments
Open

Bug in TICDC v7.5.4 version related to binary fields #11771

lee1988well opened this issue Nov 18, 2024 · 6 comments
Labels
area/ticdc Issues or PRs related to TiCDC. type/bug The issue is confirmed as a bug.

Comments

@lee1988well
Copy link

lee1988well commented Nov 18, 2024

What did you do?

TIDB upgraded from v7.5.3 to v7.5.4
TIDB从v7.5.3升级到v7.5.4

What did you expect to see?

The content saved in the blob field is information that has been compressed and then converted into binary. When this data is sent to Kafka, when consuming Kafka messages, it is decoded through ISO/IEC 8859-1 in version v7.5.3, but it needs to be decoded through UTF-8 in version v7.5.4. There is no explanation for this in the documentation.

blob字段保存的内容是压缩过后再转成二进制的信息,这个数据发到kafka中,消费kafka消息时,在v7.5.3版本中是通过ISO/IEC 8859-1解码,但是到了v7.5.4版本需要通过UTF-8进行解码,这个文档中没有任何说明

What did you see instead?

Do not upgrade for the time being.
暂时不进行升级

Versions of the cluster

The current version is v7.5.3 and there is a plan to upgrade it to v7.5.4.
目前的版本是v7.5.3,计划升级到v7.5.4

@lee1988well lee1988well added area/ticdc Issues or PRs related to TiCDC. type/bug The issue is confirmed as a bug. labels Nov 18, 2024
@lee1988well lee1988well changed the title TICDC v7.5.4版本关于二进制字段的BUG Bug in TICDC v7.5.4 version related to binary fields Nov 20, 2024
@wk989898
Copy link
Collaborator

Which protocol do you use to send to Kafka? Canal-JSON uses these two character encodings both. https://docs.pingcap.com/tidb/stable/ticdc-canal-json#binary-and-blob-types

@lee1988well
Copy link
Author

I am using the Canal-JSON protocol. The problem is that the same data is decoded using ISO/IEC 8859-1 in version v7.5.3, but it needs to be decoded with UTF-8 in version v7.5.4.

@wk989898
Copy link
Collaborator

Could you provide the data?

@lee1988well
Copy link
Author

create table tab_test3(
source_id varchar(300) primary key,
api_data longblob
);
test.txt

@wk989898
Copy link
Collaborator

wk989898 commented Nov 21, 2024

I can't reproduce this. Messages encoded through Canal-JSON are the same in these two TICDC versions.

{"id":0,"database":"test","table":"tab_test3","pkNames":["source_id"],"isDdl":false,"type":"INSERT","es":1732180083113,"ts":1732180103973,"sql":"","sqlType":{"source_id":12,"api_data":2004},"mysqlType":{"source_id":"varchar","api_data":"longblob"},"old":null,"data":[{"source_id":"0e9c92434c54f4a3f2bb860d37835dc4:7ce6bdfc1d5f5f490b6033af263c4a91:0","api_data":"H4sIAC7mImcC/02c25EsuQ1EXVkDdjf4ftii0Kf8d0HnsAj2XUkhTU9PFQkCiUQC1H/+Sf+mnPIYtayWUp219f33X35cZt279Fzq7DmP2v/+yy+3MWerM5XCn9Q5z6el5jFHH/756nOU8ylPm2mNVlPeee92n9sKz1h1F37Jr77n1p7m2KmnlnetaXwvm3ntNnZeq/U8x33ZGPxnlpbL3rmX+9w69ho5rTV2zTyl3eey0NRWXqm2PMv33dzYE/sanW3vMe8j2mw+dtbONur8npDZW+o8Y042xj/3EaPxmzVHWrmUVb4VY72xclsYoXZsd+1Q8kx1j9xY7+rfA9Lco/c9a2lp1prvx9p7rJLG4Bk+6u65lZ4SR9RbLbmeD1OffS0stHru/DCuIVLZBUtu7MOKx2fgtLHPbMkn81ff3oZbGKXN0cbiqL4PsUodM/PMkmaP/U5elMZivSxspmuczJ588qplVH66S6hpld5y4pzLPg/245l7wxd2KYnz6PlbWF2jrtk72+Ksyz3l3GeptS4cY/R6N5FLXrU2HBOH5PfX+TYHO1eZbe0aVtAT8JmdWll55OuSHT/eo2L8lebkZL8nrMFPuSYOh9XeAGCxPI1Tcwd11Gv01obb233gLhjr+zRVDDt384V97nrN01diS2UsHpHCUxceV1jpXrvUtss9H76L97PapanX992u72x8e+Cp5Tp1bvgLsYe9ceJa44iweZ6sumG0z6t1Sf6eJWQfS8DM6329sbSaOSWcAIN+Bu6tVF45+mZdbX9briOvNvDo0TXEC+S0Wegui/Aiiu7RYxbiBQ8uI+3NUj8L8yw+bpzG4Mn3iHUHXLXx5NpzLK1iAUKZB+GvfPvbBWHGw0AE8GPep9bBhkEGwiXXiDY8gefNRlQNP46n4nh4bl3L41zPq3kd/geMsOl+Y7AVcANPxDB1tzg2PApXwxJgQcJPPuOw1s1xJ3xzDJwiPi0gCO4BJh4o+D5lqyAJR1Fd2/Udnpv0DmFjElsBRg1U1qfSTJzGfQQHIHid8NhG8rfnjrVx3yQ2sLiIAZ7Av/YkRjHWCqAkeNggIQAut+t+hFbS2nMTiBsMuQ/uhI6wTiSC8TfiCrG2Z3Y1htJ1qSHGEoTdHLFvbOWx2gI2BAQsH4vwY/yao+RAq1b7wG+JGSuDwXjUBb/kVpfmTXg2LtPvQbMFPA/zTl98PjyIONMBnl7m3Zw/gd2ZE27zbPnLREBz18CtC0tvZYQ88UMOMKF9a2h4ZNqVjLEK0B8o03S0Mj13PDs8GCwDpkbF0dhzCbtnjDgT5jTXvizAd/GV3ckD7DmSGaC6To5K2uwzO6hBdBLQq5ttbzYEDQ1KtjXynNeQY7AHPJNzxrrl2wMQxbkuIgMP4qy/jQH/JFTwBJwjydysCcoSk70ABDkyVjHMCfbO6kxmdwGgFsDAyrLJcNwd8AELByyILpJLy3HCJHrPEQvz+HmdRGDAp8EozFnT3QUY1oVpcJ0Vl4jO6imDfaQkbHTjrZLCQAjMA3DcIJwcTRUM8NaSv4VlHIzEBBno5tqXM4lSnoeXktp6u5sADk1Mk5whSMXp8DIoCGQBU5KivjyWcQKOnIWR6TsZMdxJikJwsXPS6b5JhH/Xs2U9M9yfjXGO4Pn5pz7H4btYkQXggeDCC5ZGHMLEOHectdytkLwhKoDfrC89kWcO1JFxJAqRYaEI4AvYUOAlN6rwdKKhsTPZxW9zOK/cBkRsZtr7XbK1ryETzIJb3CSNsXXLhJE4pRtAVe/HRON4702bOB2gug6b5LS+cyPclx6YTfQz73Ao/4Uv823yUL74koQM1sVDZZDl8smiRxZxj/jLERZsjocfFsaiS8QrJ4OLwWQAEnz58hKiuuETWXPwmwsl5OzuoWXfOG+ex3fkCQAqzrV/yaUKIrwPR5mRCnnb1EPEOHaZ93XrCt3hfDh13rhXkCMWyQJMth5+sFoOj6cAlF221u7RceTgjSdcDJ3Pml1EJrEAVd3nRjbLUjDWSgyxvDAyzxWcNmfIa3ubgXPys6Gr4Rr7ejFrGMYmi+ZELh7IVfnDfQghf3WJFz4JsS+m8bkvqOJVWS4EteZtl2AVUz1n51mTiCJhWI8sUC3jKEAmZxNGlvZNrM/rOJa7Mj7CmBhq61ffgyFCZCDYjXG+8yP9bAP4xcz5lBXferUPxjfnCY9BeWBeEhme0mVD4fBi5za3QHF37MOzk5sAjaWXd3L+adOPMH6QfgINrsNDYIVwwojwk7PkOK4xArxIjUoDl4nfGXTBuACdyWe8SqNGpdNEcHkExilr34qEwsDgIpzGWkEigM4KrTbF7XgAXJc45EBgZBnTX8aMM4lFhB6767ca0FYJd9pauYwRvKBakOxDp3HtIIrtnAZLAGDb40KEBQUfa8ZZX1EEcCaJHnhHrEeiJj+aX0AQzHwfIJPDQ8zgTaYY7mupWDkeGWwgB4dpxlsHsNu+sYXznMTAf1On9BEOLLvbxD/xZEAFoAgp1muEIyAfxBYcyqLbwnQrXLVjLR2HXzTP7hZFRCxpVmStxOkItCQKTCZF6hyHDARM2McQteu8RZz1MG6un5BmewubHYpGCq4yvh48mCIiERnToivINavFOoBow136LUh4DxFjusSgAONdGDmA8wbpSD0S/cA00hJc0RpqC+mXhmRFAiGQj9LbhWC5SQ44Mbyt1gg5i7OsO0ExgmpSTZEczJJG7o0tKDs1IeihBNBf6VypG4okEvuYuL8VTzkir6G2ozS4B4RfN4kA5GfXFXmAP8UwOnDzMRGG5yfQvZMDiaOXrZOQBgZPEkHK6+kbPB6eqEqS6y0IWL7KAq/YLjJqiqY8cbZMIQ2A3YWQvwlPznWaEu6i8RrWK5s/ma1dVoj7TCv7w505qfFqGEEfgJAGjutsxRKIHAyugZo3lnkgzAIfYgly7PC1NiQOYD77DxpsEFDCEBaAU0BwpwoEugCNr4S59MJgt2Lbru1CRDriDSWix5meXiAAGFj+ckXtYS5lP0S+hVfgtRwJpMFABO6M3IcD8g6iqp4yPihrNWWZMeBvuNctn6dZj8AHJYSZOOVtqY5nwYvC5kCnlALcwWX73QKHjZ0sYKQhNwrBWDg5LyRcYULHXNSrvGOZdlXWrmxj1U05jwVlFjcvQDyXRKxZVREFEa2AM5tqxmAJyg76qNZgclCHvB6GPfLMwR5iJkoRSb8qnu4M2/hAUgfEnbC/VcqtDrLqiHV4dyVBguRMpJMhUwy8sKggvARwU/0lTJjV8CCwYQumjKc0yMQrQWH83pxJymdZlgEHO+7ZElx4JRFkQl8Rllism2UgsKpS39twC7wZfMO792Mk7HXIoXV/wvjoXN8jyAA+Mqv0UFQ9sY1qYnPIBCbg20Iqs8DQOu4x5BWLeRAOhNqrp3DHcyzElzrLwgd/SRoHW0fogTe/RMQBQxaElMN9XsYBL6AnwyX3sGe22MPRpP7KJN8xaXJRqh5IvJXOVheRNxYLoGAP5OhtjobZwtBjweAbFlV6Fcvni5Stk2EIVvPA7BQZvnJTrUjMvtOb/kPyHaRCAeI7UkgZDgFgD3XGEXkIIAB5RQxr5Jumcf+uuwtp7aZYIoXtYyFe2C1mA1Ct/vki/svZ7qBtgIDkQ7mhRHabCkqYkgDJLvB+yvvWUX+SsPUHs0lHxYOdl+AwTe0oHVkoYeXgxVsJQhkNngtF2TdjlQn8E24SixudqsWYrB6dasRydQbMJRzJm4IbcXCWT5wwhW57iUjhW51KMWeqX1/uKLhAlJWYx4Hvy4xNxpJ511lW1OVwT+p86n1XEqyLOh8s5Y34T//RmAFBwydFENDiHqikfyqoKf9c0a4qDgJ2/AUcqUbSW82K3L9Qy74vU45iw6RC4mn2FQCKKxiqR5anrnwxqijLt/gdbC2qKDO1uiyRsKymguF3jGRZjNGsbIPuYiAxIrv5yER1yWxxL4lmyo8tcDykZJVgQPNqnbIBJS9SmSV7+zkxIAPwUi6TvWIjljWUMxAl6u+7NFzSbE5mIiJn7K7qeYpopJaoqttJz7A3Hr8VaEMWldV4kBDqW5azVPNFNjvhxRHiQH6WC4kcTxIiwUPwYHlkWBBihiKpEqeWobibZwg9lLEya00ZkYH7C+BwKaOxBZsDLP0U59Hbcn9a1RQcoHLjLObyNha85MusQRYaVIFST2muW4ym/D1ZTQh8OOo37vVsDh9qqpFKSdGH4AyJJEJbQWjPW7oAIafYmhbx5VaiHPo2KzcWteZrFFmmQIqqUS+PjjQl/4SBwCpWyS9ui7SzqVjs0ymLj/keFsYecPmb0k6Rq+ZFKs7Bog+ECmhKIbPkVzcARx5xlz1dPAGOOB1S7bDpFjL5V4ob8Muq6ip02KAf/VXSUXY0zNRpCW8wgqWk0AW6monCyyYpPta2bD4Nw4hC4/JUrGAL0FYNNn7Bpgk4HSrR3J+mn+VJ9UiflF0jhHYeaWzL0EkGUSDYOCknNi1ILn7Kj7AteaUqqsVyk+Q5WbJZn0YQNxWmrbKgd0bAZ4sxIxBIw/9CT5yqr5i3qK1H9sX35Ayf5Bsu2Y/KZw63f5ne63CYbWPC4mE/+XIdocigkJqFxK1AZKMJ4EqvHdMgU7zmIESNfg7W5hDBZJzCYuqRpNOJpIKzkXHJjPLiEfZXcw+3dGereDuckB1Hj8f6uinOQcFUhS48kWpsw3EIyv1PiGa3BBl4ZeaUVL2DG1JECXexAxO1d1dlwPNshEWLJJ+mLKUA66ZQvFbjVZRkSk1boaj8Ysgu6mI1uERYWHm2bJUGAv9yYzuqBDE2UHrMT6jvpKtp3QRHbxfRxrJbBxIRXT8Fi5VPe2M2WGwfP+EGrMfs6n7tcaFM0bplaQYIGSaHOsIpKu9MJdK3Zer3rfoFjlp9BKTV093rhxfYjb3SqJWSPSgQl0Po0RlgSVW5UQgMXO1yUJ5eT4ba0UjLpw8i0cqXo0szDpyaSMpTR07zy9aGZGaGT+G1dhTIb/U0ta92LXHnR/IIkbjy44rk/iaJ8H/VaMFaFU5FBSuQ/svTlmMECC7cA66p9vBHE5Q6+nwqI45C0rMXRYyU6NjK0+08bzvoL9NbrPM9i60LEbZVwb9phuT77ygs4Zu99yle37cBR1I3MR/PXBFGeI59buxtk7wHUzQNDlkk1nng1UUIDOEUw+WqpDZp1JAeUc7t+CbJolgWycLTDUTeqr1NhRUb5ec5dR2+cmB7Bd0F9KbFMcm/9Rg3yHZki41qIOX1uMkGRhDBNvSK6ICpBvAn0Kxu1/M1SJaxBXLhDq8PAcRZAqnkU360X7iYq5vMqwXyVLNuX19sWE5fPKkafVq32SW5hRhJOFszLOX+iHlVZIy47Nli4gh5JweG4Wk/+TabysndgDcnh5GuhlbtQ9ZPsjU0b9ozWJxNsEYb9TFg/pqiTCHM7vzNprgDXlZtkqz5K2lOR9XGYT91xU1Qu1i3cpQWABdhKBgECKsJRfL8OslqyZzNdsjg0UnljHp8qZjUI9HbsuPt2yfUeuPYWLC/UKyh3siCZuFsYJjVHnMkKPKweL+pEtYfuIxtTG9THWPfyh7eoObo1ENXlZyPiNvp7aq1Sm4r6k6p7rbNYmVyHZAU049fle0Ix+t7OD/iseAYrycOoOL/nqidlqfEWT8RaeqZh/aH5Q4xMEcu51sei5YWaDpbtsEN1E4ogZyacFOhO0/3Suqt9mHi/HuzpFALyAZSGK6ZYtVNuqVjaLPmAugGGAaNzekpUFXfghg7f9NCBGuKtsXe+SYjBNvc9ubNZu0Y9DqsjVHVnq3i/3qm0H4V/318e716CYgk4oVBUTq+TAXYsDpEZL1+kbmpC7N2ajnH23IoLAj3wz1V/Gc0gCx7THUyqLGi72EH/vBz67AQJLEvzGmoDuUYqOAtrFQjO3v0Jj26zfeTr5vs+NlXSUTV1EmvWoO+1X1aOqcKancqo7dDB8HyJQd9vYHTIVoSGRh1b8FFyhGTFZjwebz3Enr1gk9rreP102wLHD3UpL2f/FEPFS52G/O8Fa1TFnzHthVO+aYO8AO/XM8IxJVVq6ozZITUbMfoeTbnQ33LYQO5hHMkdmWe5DjYoRElUo/xbXwSNikWfIo1TM8Lu4T6xqJMwZkwnjvtJD3CmU7pql3lsjeL2xLetsf0/fQovdLAsEzcRl30VHx/8kzNt9/SlF8kgM3Rtnk7wucFovCZ3+mBNDbLz2ygInM9UPNF3Rnrs7gDafbVQakEHAmzEeo80455BMFKaZLv1ju1AkiyCx3iMNU4DhdFYCpNqc8EhC1lpCyjBjD3zaHT4S6VU2d11rNDGfIofE68iIyfBP0t8Gf7lS2Q34GSM3TQK3kkuAjWLVZXivP1j9qREC/lEOShCh4lMI6w1KP4RYm+DK85Lmj81NAXTndBlQZLwrZ+6sBSqYU6lxxPtWK0KdznaUaGq7nRznNx69MBvgWWYhgpFG6gt94TtZdVTew200gu5bUdeC7IvaUeIZKqnDv54vSJPvswMDliJd9hw70+Raw7vOYMDnj5COpSDsWnlFxu43UeJM5n4HOHSuLsA76bTi9SUeNygW3QOQOxraMD4OU8QIEjT/Z+o2iCeDjVpolKaj/Ncip02Mhp4xO9Pz5MEUpBZ0fJiYeb19RW7V7ZXo4ZICdkBBXwcMqa4n2QCVsvpuQnpttrTvbuMLF93RugDi4a9pxU7lF5WSXjHrJQW2LRgGlnGHVZrgxVwKu+2Z+Tvi5dd8agF34J1ipQ9iviJMMQ7CRCkjAfX1XiIjFDiNRd73eztZYyHfSDIK0j5jjtKgjlmvg+WH0M1Fl6d24x2XPEIbsZhuyru2ySYIHG+6SPd2oPt7YcU2OCkbdXMjkziKfa2pM+vIljaSjJSiL36lI2T4Gu8+C3FoglGqeOck1nAmx9xyFtW3/OfjbnokJyrOrFyZESDRIKkfIv52Sry8DroeA6gdyUqIcDM9FKEQLt+ODkpNMIffnbPhOpw17pqzkA4zK/UaXHBdMRnXEBEHpdI6u09FMPkWFHNBeLmdI+z7L0TU8uTk6OyDlgrzO0q5PM8lEBxYbyuD17Whqo2LGL2VG4tkMxamYpJMNsM8EGCw5vYrizrtgv68KOcBG7AWwESjb7z2kTeL0B7NMmte6RIcXgMuXUGVVtHx+M7eE58DtJnydy7e6XHPGQVr+wtc5ir+206GMs8YwzF3X33J4KTQ49TiXnM3XnN3VZdZVs/zzdEREHOxwvVYCe74jgQhTt9ehP2XGOyzpNzLqEdVWLB2wHEPEd088ZGTu2EZVxaYJ8zXcS2VWSu9xGjWBuzjJOyYiq81Oe0lGP7WGx7sfMTERZH1ZI30HBbCVS/hZRo7W9fuN09YC8c0Or/Nn0lnNSjLyhIYoB63KLzn3aofd1oocSuALda/QOm8qlnjG90a/UUQQC206nJn9pqpm5sjWBXcXLqiCscLDpNKhz7z9Fyj4pR+rQVonGj6MoZOqq/kGY/Pod9YysSVTlbq+DZWE6lbugRrPN51T+ufC+neUL+dSJNruQQ6YaRnaa1SkE80GK0uAUIF38cH7gJrp9ZmGyQ2SnI39J1emB2RQbK0V9S2w5EacuYoRE41DZyn6tNbXELBqEngzU58xQ15io8soFwaHGv58IXZ0+YEeyhtFeNXT6cg6FupD9KMbQRZTRlL4ftTOjYn4AzNm5X6rDsI6OOMevLY9EM/6tipzTKkMvHf/75yrMcNwzH2M4vuaqo9FOhFgnLXXTd3OCCmva98UuLQCaLTuUspxAccz/LhqvVjEdKlbtJ3htB+6AN1KuS+v/wpqqfzqrufktzGE752uc4wcd8z2SD6DnUbUcWHmp5nTwjVtLjBpcZ1qhEBJOavxG6G2k2pQWHq2AblHt0BBRY2u+9m/08FMd7GKBViDb06mtAfsZd1O7itKX35PvhvTTzkqPvq8sQX3UquN1zIklx/SkMfNVnc4NJ5s8TQnzIZ5DiCza2qM8EgU1cOjPyUxTZg9R5jDJ5IB/j3FNCxHnZXBQ70XEWHxVIfEJLLHnd90k2WPmgTp34BUbc/yo6Oa5XLhqx9e2qcCZ+RiBav4sh1cEvGWLLSjW0M+oUc0x7ALqimzmHfLNG2mvZzygqMo7G5Tj0oCGLTZy1wpKYtfXvlzaX36PyseTkLg4jj53DAicWR5ciJpVbvKKlNOAch4coOc821MVs4NJU92ARUcPXUXP3kC3L3ezs8Nw+4x+dYvxJ+UWq2Z1Fxl7oOZQ3ddjkxPOr7Fj78dGlrcj1oyUWx3ikzSSYMfT6fIpJYrTetuSOmRMh/ApfPK8rbevdbGVR7xq43zSax0rDWMIxxri9o7hSQHpDZH1686mk31OiKibvqizV0lu8d6AFzSCfIDDB33sZz5lwIaiVdZ20NUhkqi/5d4+gpTxWpOmPDLScgg/r6sAbS8y9dO79VDHnU89M3LLjqPt8V+9Z2PWvOBUWo7pBSLJz2T8M6JDtJXD932U2xjLsbkvitn6OPLNnTev586Bl9KiiWN31Vac/R7cNZggMeAIUXYsgpMLhumclMMoNkdKDKieBqsD3EZUajEef3rP7bAlBw+jNQnRGnaIxhn7+rFGr7KAmKandWfpFbeUspb1NM+4gOBlLgmFwz1/JJWv3dhObZbSgxpOwaaYwpPHv56ymOX89dzvqbFi+V4vysTeNllvGnA6KXs04RgmcfUkCFEG8ptfR81az66wgfKuZrRzb+QoVGuFxH+aUEddc1IoCowzcZItic+FtRYXkewPd/WcdytSgJkOcHoPjsN6w7cYUU7vjR1v1V0Q3N786mpnypvXp/RAauRmLf1uBHBmDmxkLyf8pk6zWr243bKkPbc3Ye+VtKUu0d/9G6nsEsGc5stxRlY9Xrw5XUxc6X65pHMeJwWpBMbIhxqcQgGYFkn4DGo4dEQyycG1hxPz0tyu/XcMC1XnyLzA8Mo0RzemX5822EaUoY7eeWxKWeXlTl5SzoWAfKYPVhBM6qZxZo26I1FBA5uVhY0zuWT6qf5WZF1V1Cs1NeD25ClIS3ZaK/jWaazI0ECaFJLruQo2zO2c0xtj2zbNjjJF9RdTXlle73w9B5mDDzlsX51ZyNm7ZuPdMSFnmOiKhW7c+lteB7Q3JIUJbzCcmu2/M2iV3yTUmUc8uro0JaArOf5JiFvu51JiCD47TG1vaIkzIXcVp7wOcnTvNpanCBUnhhxtBIfvJVeHnZXUTbazxmSn1+OcF+WYs4V2ALPRtpUohLweVxUUqb15h6mIhTdt6ADduQ1nQ/u5ez3Nccduqj3OuBHoBS1qsq2U3t+dN2dZ1QNUC0iQL/UoYeE76mzNidCIOmclTRJe+Hv80kFbh4G/JPQGPJfKmHcpKcGepOPFWSvLUo+k+uqn5o0xJ3jmmyLjE9lFc0CJhLXigvFyQhsnbEchjQj1As13X8f+wet1eN2AXzT7tTk6onZfiiqiNdGbOZ7nnqoL7zGzVvfppuj5p3qM9tcZxFcn7vbV3jWyqu1PxZhvJjg67jI9HME7Ln0AtBq9q3TPG/mOJZxCUliR+3wPGA7uH2i3Z7d/AwXJzod0HDrkCsq/0xuCKr7ynz7h9S/HaKxz88k7GvN37dcrBQ5OOQVYoyB2qtIZgellu3f3zkEr68czdDpi0t+LJN4ykBC6/Uc8MIYT3KTWlaJbVl23KrNemmIkP8suh4MTQkmL5OP9FMWEfsbp3qyoc+H8sTcyd4reAZFuc88UTOik9iO6WWZfHN8PgfUoCY5DVjN8+amY9vwsDuzm9N9lp3yuga0jRcRYwDq3RDwt7/jUN34swmMbp3Re0xgfclrB2Wfd+DUZP8Jmbys5iPVmmCkDJet2WHN6d1vw9aOJQJdajGZ7rE6ZYniHOnd0xuTl9pLtgKt4xP/rQFWw2kpc9df4cZCbmMn63Br5XbLV55SX1VUeOxNim6xfErL7j8dbkqxzxTRcVA1GoDzz92/k1M6TkPAJjDH+MU4R6M04TrYH1UlnmN0rUFVfvKugHLYk9gKHVWaUrukMQcs8h02DqO2ajfkzDbGc8HmSJXY3q5hVn6rnrCDliIWo87ABhfM8wQ47hW6seHpTgPec+0NO+rxvOw8AuOTTey0xIWB36yBhd2i7/vf/PI+jw0xCAAA="}],"_tidb":{"commitTs":454080615707574279}}

@lee1988well
Copy link
Author

The data is compressed using gzip and then converted into binary to be stored in longblob. When consuming, in version v7.5.3, the data is first converted from iso8859-1 to utf-8 before decompression. However, in version v7.5.4, no such conversion to utf-8 is necessary, the data can be decompressed directly.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/ticdc Issues or PRs related to TiCDC. type/bug The issue is confirmed as a bug.
Projects
None yet
Development

No branches or pull requests

2 participants