Skip to content

clickpipes: improve MySQL CDC documentation #4101

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 6 commits into
base: main
Choose a base branch
from
Open

clickpipes: improve MySQL CDC documentation #4101

wants to merge 6 commits into from

Conversation

morsapaes
Copy link
Contributor

Summary

  • Added a new page for schema change handling in MySQL CDC.
  • Patched some technical details (cc @Amogh-Bharadwaj, @serprex for ✅):
    • Increased recommended binlog retention hours for Aurora and RDS MySQL from 24 to 72 hours, motivated by this discussion.
    • Reviewed stated MySQL version support for Aurora and RDS MySQL, which was correct for RDS but incomplete for Aurora. For Aurora, specifically removed the mention to 8.4 (not supported), and switched to using their version terminology, including a mention to Aurora Serverless v2 — customers tend to use that rather than MySQL versions.
  • Improved overall consistency between PostgreSQL and MySQL CDC documentation.

@morsapaes morsapaes requested review from a team as code owners July 18, 2025 15:00
@morsapaes morsapaes requested a review from mzitnik July 18, 2025 15:00
@vercel Vercel
Copy link

vercel bot commented Jul 18, 2025

@morsapaes is attempting to deploy a commit to the ClickHouse Team on Vercel.

A member of the Team first needs to authorize it.

@vercel Vercel
Copy link

vercel bot commented Jul 18, 2025

You must have Developer access to commit code to ClickHouse on Vercel. If you contact an administrator and receive Developer access, commit again to see your changes.

Learn more: https://vercel.com/docs/accounts/team-members-and-roles/access-roles#team-level-roles

serprex
serprex reviewed Jul 18, 2025
View reviewed changes
docs/integrations/data-ingestion/clickpipes/mysql/schema-changes.md

ClickPipes for MySQL can detect schema changes in the source tables and, in some cases, automatically propagate the changes to the destination tables. The way each DDL operation is handled is documented below:

[//]: # "TODO Extend this page with behavior on rename, data type changes, and truncate + guidance on how to handle incompatible schema changes."
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we don't currently propagate any of these. to alter columns they should add new column with new name & drop old column

@Blargian
Copy link
Member

@morsapaes do you want to leave this up for now for testing your vercel permissions? Otherwise I can make an edit so we can merge.

@morsapaes
Copy link
Contributor Author

Let's merge it, no need to block it on Vercel. Thank you both!

@Blargian Blargian requested a review from a team as a code owner July 19, 2025 09:38
@vercel Vercel
Copy link

vercel bot commented Jul 19, 2025 •
edited
Loading

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Updated (UTC)
clickhouse-docs ❌ Failed (Inspect) Jul 19, 2025 9:47am

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@serprex serprex serprex approved these changes

@mzitnik mzitnik Awaiting requested review from mzitnik mzitnik was automatically assigned from ClickHouse/integrations

@Amogh-Bharadwaj Amogh-Bharadwaj Awaiting requested review from Amogh-Bharadwaj

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@morsapaes @Blargian @serprex