cdc 2.2.1 cdc Incremental snapshot for tables requires primary key, but table doesn't have primary key #1501
Unanswered
JavaKingCr
asked this question in
Q&A
Replies: 1 comment 1 reply
-
同问下,在sql下可以设置 with( 'scan.incremental.snapshot.enabled' = 'false'),但是在datastream api下并没有提供设置的方法啊,这导致无主键表无法同步啊 |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
使用 Datastream Api 将 Mysql Binlog 收集到 Kafka 时,我发现当某些表没有主键时会出错
我的代码:
val env = StreamExecutionEnvironment.getExecutionEnvironment
checkPoint(env)
val mysqlCDCSource = MySqlSource.builder().hostname(Common.mysqlHostName).port(3306)
.databaseList(Common.mysqlPBQDataBase)
.tableList("")
.username(Common.mysqlUserName)
.password(Common.mysqlPassword)
.startupOptions(StartupOptions.initial())
// .deserializer(new JsonDebeziumDeserializationSchema)
// .deserializer(new StringDebeziumDeserializationSchema)
.deserializer(new CustomerDeserialization)
.includeSchemaChanges(true)
.build()
Beta Was this translation helpful? Give feedback.
All reactions