MySql CDC Connector Database and Table Filter #2127
Unanswered
alper-basaran
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Looking to answer a question, any help is appreciated!
I am using Flink CDC connector for MySQL and it works just as expected, captures the snapshot of the specified tables initially, and then listens for the changelog events. What I am trying to understand, however, is which binlog entries are being received by my Flink application. My goal is to listen to a specific table, however, I am not sure if the binlog filtering happens in the server side (MariaDB) or the client side (Flink).
I did sniff the TCP traffic between my Flink app and MariaDB and observed that all change events from all tables are being transmitted over the network, even when I specify only one table from one database using
database-name
andtable-name
connector options. Therefore I concluded that the filtering happens on the client side, and the connector is discarding the irrelevant entries.Is there any way to push down the binlog filtering to the server side, to avoid consuming too much network bandwidth?
Thanks,
Alper
Beta Was this translation helpful? Give feedback.
All reactions