MySQL Reader时候发生的错误

[me1dlinger]

这两天的一个定时数据交换任务经常报这个超时错误导致采集出错，请问是数据库服务端的问题还是采集端的问题

�[36m2022-11-26 23:06:40.589�[0;39m �[32m[       job-0]�[0;39m �[34mINFO �[0;39m �[35mStandAloneJobContainerCommunicator�[0;39m - Total 926688 records, 293557151 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 0.111s |  All Task WaitReaderTime 1,250.447s | Transformer Success 926689 records | Transformer Error 0 records | Transformer Filter 0 records | Transformer usedTime 20.290s | Percentage 0.00%
�[36m2022-11-26 23:06:49.269�[0;39m �[32m[0-0-0-reader]�[0;39m �[1;31mERROR�[0;39m �[35mReaderRunner        �[0;39m - Reader runner Received Exceptions:
com.wgzhao.addax.common.exception.AddaxException: Code:[DBUtilErrorCode-06], Description:[执行数据库 Sql 失败, 请检查您的配置的 column/table/where/querySql或者向 DBA 寻求帮助.].  - 执行的SQL为: 


具体错误信息为：java.sql.SQLException: Error retrieving record: Unexpected Exception: java.net.SocketException message given: Connection reset

Nested Stack Trace:


** BEGIN NESTED EXCEPTION ** 

java.net.SocketException
MESSAGE: Connection reset

STACKTRACE:

java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:210)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at com.mysql.cj.protocol.ReadAheadInputStream.fill(ReadAheadInputStream.java:107)
	at com.mysql.cj.protocol.ReadAheadInputStream.readFromUnderlyingStreamIfNecessary(ReadAheadInputStream.java:150)
	at com.mysql.cj.protocol.ReadAheadInputStream.read(ReadAheadInputStream.java:180)
	at java.io.FilterInputStream.read(FilterInputStream.java:133)
	at com.mysql.cj.protocol.FullReadInputStream.readFully(FullReadInputStream.java:64)
	at com.mysql.cj.protocol.a.SimplePacketReader.readMessage(SimplePacketReader.java:108)
	at com.mysql.cj.protocol.a.SimplePacketReader.readMessage(SimplePacketReader.java:45)
	at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readMessage(TimeTrackingPacketReader.java:57)
	at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readMessage(TimeTrackingPacketReader.java:41)
	at com.mysql.cj.protocol.a.MultiPacketReader.readMessage(MultiPacketReader.java:61)
	at com.mysql.cj.protocol.a.MultiPacketReader.readMessage(MultiPacketReader.java:44)
	at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:75)
	at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:42)
	at com.mysql.cj.protocol.a.NativeProtocol.read(NativeProtocol.java:1688)
	at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:202)
	at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:66)
	at com.mysql.cj.jdbc.result.ResultSetImpl.next(ResultSetImpl.java:1724)
	at org.apache.commons.dbcp2.DelegatingResultSet.next(DelegatingResultSet.java:1160)
	at org.apache.commons.dbcp2.DelegatingResultSet.next(DelegatingResultSet.java:1160)
	at com.wgzhao.addax.rdbms.reader.CommonRdbmsReader$Task.startRead(CommonRdbmsReader.java:238)
	at com.wgzhao.addax.plugin.reader.mysqlreader.MysqlReader$Task.startRead(MysqlReader.java:126)
	at com.wgzhao.addax.core.taskgroup.runner.ReaderRunner.run(ReaderRunner.java:82)
	at java.lang.Thread.run(Thread.java:748)


** END NESTED EXCEPTION **


	at com.wgzhao.addax.common.exception.AddaxException.asAddaxException(AddaxException.java:50)
	at com.wgzhao.addax.rdbms.util.RdbmsException.asQueryException(RdbmsException.java:45)
	at com.wgzhao.addax.rdbms.reader.CommonRdbmsReader$Task.startRead(CommonRdbmsReader.java:249)
	at com.wgzhao.addax.plugin.reader.mysqlreader.MysqlReader$Task.startRead(MysqlReader.java:126)
	at com.wgzhao.addax.core.taskgroup.runner.ReaderRunner.run(ReaderRunner.java:82)
	at java.lang.Thread.run(Thread.java:748)
�[36m2022-11-26 23:06:49.591�[0;39m �[32m[       job-0]�[0;39m �[1;31mERROR�[0;39m �[35mJobContainer        �[0;39m - 运行scheduler出错.
�[36m2022-11-26 23:06:49.591�[0;39m �[32m[       job-0]�[0;39m �[34mINFO �[0;39m �[35mStandAloneJobContainerCommunicator�[0;39m - Total 926688 records, 293557151 bytes | Speed 279.96MB/s, 926688 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 0.111s |  All Task WaitReaderTime 1,250.447s | Transformer Success 926689 records | Transformer Error 0 records | Transformer Filter 0 records | Transformer usedTime 20.290s | Percentage 0.00%

[wgzhao]

从报错信息来看，猜测是服务端主动中断了本次连接。

可以尝试在json配置文件中，设置 fetchSize ，尝试一个较小的值，减少每批次的数据量，看看是否能解决该问题

[me1dlinger]

好的，感谢您的回复