sqlserver com.microsoft.sqlserver.jdbc.SQLServerException: Connection reset #2548
Unanswered
lschampion
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
error: sqlserver com.microsoft.sqlserver.jdbc.SQLServerException: Connection reset
after a few monent check, I found:
(1) sqlserver database is high avaliable.
(2) this error is occur before the database switch to slaver from master.
cdc version: 2.2.1
flink version: 1.13.6
sqlserver version: Microsoft SQL Server 2019 (RTM-CU19) (KB5023049) - 15.0.4298.1 (X64)
Jan 27 2023 16:44:09
Copyright (C) 2019 Microsoft Corporation
Enterprise Edition: Core-based Licensing (64-bit) on Windows Server 2019 Datacenter 10.0 (Build 17763: ) (Hypervisor)
java version: 1.8
after 10+ day running sqlserver connector of flink cdc,report an error:
Error log：
2023-10-12 16:08:10,181 ERROR io.debezium.pipeline.ErrorHandler [] - Producer failure
com.microsoft.sqlserver.jdbc.SQLServerException: Connection reset
at com.microsoft.sqlserver.jdbc.SQLServerConnection.terminate(SQLServerConnection.java:2892) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSChannel.read(IOBuffer.java:2031) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSReader.readPacket(IOBuffer.java:6418) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSCommand.startResponse(IOBuffer.java:7579) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(SQLServerPreparedStatement.java:590) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement$PrepStmtExecCmd.doExecute(SQLServerPreparedStatement.java:522) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:7194) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:2935) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:248) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:223) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.executeQuery(SQLServerPreparedStatement.java:444) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.jdbc.JdbcConnection.prepareQueryAndMap(JdbcConnection.java:740) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerConnection.getMaxLsnResult(SqlServerConnection.java:149) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource.execute(SqlServerStreamingChangeEventSource.java:135) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:152) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:119) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0-internal]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0-internal]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0-internal]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0-internal]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0-internal]
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:210) ~[?:1.8.0-internal]
at java.net.SocketInputStream.read(SocketInputStream.java:141) ~[?:1.8.0-internal]
at com.microsoft.sqlserver.jdbc.TDSChannel.read(IOBuffer.java:2023) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
... 19 more
2023-10-12 16:08:10,238 INFO io.debezium.pipeline.ChangeEventSourceCoordinator [] - Finished streaming
2023-10-12 16:08:10,238 INFO io.debezium.pipeline.metrics.StreamingChangeEventSourceMetrics [] - Connected metrics set to 'false'
2023-10-12 16:08:10,561 WARN io.debezium.connector.common.BaseSourceTask [] - Going to restart connector after 10 sec. after a retriable exception
2023-10-12 16:08:10,608 INFO io.debezium.jdbc.JdbcConnection [] - Connection gracefully closed
2023-10-12 16:08:10,609 INFO io.debezium.jdbc.JdbcConnection [] - Connection gracefully closed
2023-10-12 16:08:10,610 INFO io.debezium.embedded.EmbeddedEngine [] - Retrieable exception thrown, connector will be restarted
com.ververica.cdc.connectors.shaded.org.apache.kafka.connect.errors.RetriableException: An exception occurred in the change event producer. This connector will be restarted.
at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:38) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource.execute(SqlServerStreamingChangeEventSource.java:292) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:152) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:119) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0-internal]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0-internal]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0-internal]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0-internal]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0-internal]
Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: Connection reset
at com.microsoft.sqlserver.jdbc.SQLServerConnection.terminate(SQLServerConnection.java:2892) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSChannel.read(IOBuffer.java:2031) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSReader.readPacket(IOBuffer.java:6418) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSCommand.startResponse(IOBuffer.java:7579) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(SQLServerPreparedStatement.java:590) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement$PrepStmtExecCmd.doExecute(SQLServerPreparedStatement.java:522) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:7194) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:2935) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:248) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:223) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.executeQuery(SQLServerPreparedStatement.java:444) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.jdbc.JdbcConnection.prepareQueryAndMap(JdbcConnection.java:740) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerConnection.getMaxLsnResult(SqlServerConnection.java:149) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource.execute(SqlServerStreamingChangeEventSource.java:135) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
... 7 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:210) ~[?:1.8.0-internal]
at java.net.SocketInputStream.read(SocketInputStream.java:141) ~[?:1.8.0-internal]
at com.microsoft.sqlserver.jdbc.TDSChannel.read(IOBuffer.java:2023) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSReader.readPacket(IOBuffer.java:6418) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSCommand.startResponse(IOBuffer.java:7579) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(SQLServerPreparedStatement.java:590) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement$PrepStmtExecCmd.doExecute(SQLServerPreparedStatement.java:522) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:7194) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:2935) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:248) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:223) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.executeQuery(SQLServerPreparedStatement.java:444) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.jdbc.JdbcConnection.prepareQueryAndMap(JdbcConnection.java:740) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerConnection.getMaxLsnResult(SqlServerConnection.java:149) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource.execute(SqlServerStreamingChangeEventSource.java:135) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
... 7 more
2023-10-12 16:08:10,610 INFO io.debezium.connector.common.BaseSourceTask [] - Awaiting end of restart backoff period after a retriable error
and after about 7 times reties, cdc finaly stop the connector:
2023-10-12 16:08:20,663 WARN io.debezium.relational.history.DatabaseHistoryMetrics [] - Unable to unregister the MBean 'debezium.sql_server:type=connector-metrics,context=schema-history,server=sqlserver_transaction_log_source': debezium.sql_server:type=connector-metrics,context=schema-history,server=sqlserver_transaction_log_source
2023-10-12 16:08:20,664 ERROR com.ververica.cdc.debezium.internal.Handover [] - Reporting error:
java.lang.IllegalStateException: Retrieve schema history failed, the schema records for engine b5768114-1849-43ee-83e8-12b259a398dc has been removed, this might because the debezium engine has been shutdown due to other errors.
at com.ververica.cdc.debezium.utils.DatabaseHistoryUtil.retrieveHistory(DatabaseHistoryUtil.java:77) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.ververica.cdc.debezium.internal.FlinkDatabaseSchemaHistory.configure(FlinkDatabaseSchemaHistory.java:82) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.relational.HistorizedRelationalDatabaseConnectorConfig.getDatabaseHistory(HistorizedRelationalDatabaseConnectorConfig.java:105) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.relational.HistorizedRelationalDatabaseSchema.(HistorizedRelationalDatabaseSchema.java:39) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerDatabaseSchema.(SqlServerDatabaseSchema.java:34) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerConnectorTask.start(SqlServerConnectorTask.java:84) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:130) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.common.BaseSourceTask.startIfNeededAndPossible(BaseSourceTask.java:207) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.common.BaseSourceTask.poll(BaseSourceTask.java:148) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:788) [blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.embedded.ConvertingEngineBuilder$2.run(ConvertingEngineBuilder.java:188) [blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0-internal]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0-internal]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0-internal]
2023-10-12 16:08:20,665 INFO io.debezium.embedded.EmbeddedEngine [] - Stopping the embedded engine
at com.ververica.cdc.debezium.utils.DatabaseHistoryUtil.retrieveHistory(DatabaseHistoryUtil.java:77)
at com.ververica.cdc.debezium.internal.FlinkDatabaseSchemaHistory.configure(FlinkDatabaseSchemaHistory.java:82)
at io.debezium.relational.HistorizedRelationalDatabaseConnectorConfig.getDatabaseHistory(HistorizedRelationalDatabaseConnectorConfig.java:105)
at io.debezium.relational.HistorizedRelationalDatabaseSchema.(HistorizedRelationalDatabaseSchema.java:39)
at io.debezium.connector.sqlserver.SqlServerDatabaseSchema.(SqlServerDatabaseSchema.java:34)
at io.debezium.connector.sqlserver.SqlServerConnectorTask.start(SqlServerConnectorTask.java:84)
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:130)
at io.debezium.connector.common.BaseSourceTask.startIfNeededAndPossible(BaseSourceTask.java:207)
at io.debezium.connector.common.BaseSourceTask.poll(BaseSourceTask.java:148)
at io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:788)
at io.debezium.embedded.ConvertingEngineBuilder$2.run(ConvertingEngineBuilder.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2023-10-12 16:08:20,702 INFO io.debezium.embedded.EmbeddedEngine [] - Stopping the embedded engine
Beta Was this translation helpful? Give feedback.
All reactions