Dm运行的时候relay出错

🪐 TiDB 技术问题 备份&数据迁移
1 
» query-status
{
    "result": true,
    "msg": "",
    "workers": [
        {
            "result": true,
            "worker": "10.140.15.204:8262",
            "msg": "",
            "subTaskStatus": [
                {
                    "name": "syncspot",
                    "stage": "Running",
                    "unit": "Dump",
                    "result": null,
                    "unresolvedDDLLockID": "",
                    "dump": {

                    }
                }
            ],
            "relayStatus": {
                "masterBinlog": "(mysql-bin.010657, 2804796)",
                "masterBinlogGtid": "bb02c435-3e55-11e9-8425-42010a8c0093:1-2525265614",
                "relaySubDir": "bb02c435-3e55-11e9-8425-42010a8c0093.000001",
                "relayBinlog": "(mysql-bin.010603, 4910)",
                "relayBinlogGtid": "bb02c435-3e55-11e9-8425-42010a8c0093:1-2384044951",
                "relayCatchUpMaster": false,
                "stage": "Paused",
                "result": {
                    "isCanceled": false,
                    "errors": [
                        {
                            "Type": "UnknownError",
                            "msg": "event from 4910 in /home/tidb/deploy/relay_log/bb02c435-3e55-11e9-8425-42010a8c0093.000001/mysql-bin.010603 diff from passed-in event u0026{Timestamp:1565273892 EventType:UpdateRowsEventV2 ServerID:2586028381 EventSize:8104 LogPos:13014 Flags:0}
github.com/pingcap/dm/relay/writer.checkIsDuplicateEvent
	/home/jenkins/workspace/build_dm_master/go/src/github.com/pingcap/dm/relay/writer/file_util.go:156
github.com/pingcap/dm/relay/writer.(*FileWriter).handleDuplicateEventsExist
	/home/jenkins/workspace/build_dm_master/go/src/github.com/pingcap/dm/relay/writer/file.go:363
github.com/pingcap/dm/relay/writer.(*FileWriter).handlePotentialHoleOrDuplicate
	/home/jenkins/workspace/build_dm_master/go/src/github.com/pingcap/dm/relay/writer/file.go:306
github.com/pingcap/dm/relay/writer.(*FileWriter).handleEventDefault
	/home/jenkins/workspace/build_dm_master/go/src/github.com/pingcap/dm/relay/writer/file.go:281
github.com/pingcap/dm/relay/writer.(*FileWriter).WriteEvent
	/home/jenkins/workspace/build_dm_master/go/src/github.com/pingcap/dm/relay/writer/file.go:130
github.com/pingcap/dm/relay.(*Relay).handleEvents
	/home/jenkins/workspace/build_dm_master/go/src/github.com/pingcap/dm/relay/relay.go:387
github.com/pingcap/dm/relay.(*Relay).process
	/home/jenkins/workspace/build_dm_master/go/src/github.com/pingcap/dm/relay/relay.go:279
github.com/pingcap/dm/relay.(*Relay).Process
	/home/jenkins/workspace/build_dm_master/go/src/github.com/pingcap/dm/relay/relay.go:187
github.com/pingcap/dm/dm/worker.(*realRelayHolder).run
	/home/jenkins/workspace/build_dm_master/go/src/github.com/pingcap/dm/dm/worker/relay.go:155
github.com/pingcap/dm/dm/worker.(*realRelayHolder).Start.func1
	/home/jenkins/workspace/build_dm_master/go/src/github.com/pingcap/dm/dm/worker/relay.go:131
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1337
check event u0026{Timestamp:1565273892 EventType:UpdateRowsEventV2 ServerID:2586028381 EventSize:8104 LogPos:13014 Flags:0} whether duplicate in /home/tidb/deploy/relay_log/bb02c435-3e55-11e9-8425-42010a8c0093.000001/mysql-bin.010603
handle a potential duplicate event u0026{Timestamp:1565273892 EventType:UpdateRowsEventV2 ServerID:2586028381 EventSize:8104 LogPos:13014 Flags:0} in mysql-bin.010603"
                        }
                    ],
                    "detail": null
                }
            },
            "sourceID": "mysql-replica-01"
        }
    ]
}

请问这个可以怎么解决？我试着执行sql-skip也不行

» sql-skip -w "10.140.15.204:8262" -b "mysql-bin|010603:13014" syncspot
{
    "result": true,
    "msg": "",
    "workers": [
        {
            "result": false,
            "worker": "",
            "msg": "such operation is only available for syncer, but now syncer is not running. current unit is Dump
github.com/pingcap/dm/dm/worker.(*SubTask).SetSyncerSQLOperator
	/home/jenkins/workspace/build_dm_master/go/src/github.com/pingcap/dm/dm/worker/subtask.go:546
github.com/pingcap/dm/dm/worker.(*Worker).HandleSQLs
	/home/jenkins/workspace/build_dm_master/go/src/github.com/pingcap/dm/dm/worker/worker.go:311
github.com/pingcap/dm/dm/worker.(*Server).HandleSQLs
	/home/jenkins/workspace/build_dm_master/go/src/github.com/pingcap/dm/dm/worker/server.go:335
github.com/pingcap/dm/dm/pb._Worker_HandleSQLs_Handler
	/home/jenkins/workspace/build_dm_master/go/src/github.com/pingcap/dm/dm/pb/dmworker.pb.go:3902
google.golang.org/grpc.(*Server).processUnaryRPC
	/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:966
google.golang.org/grpc.(*Server).handleStream
	/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:1245
google.golang.org/grpc.(*Server).serveStreams.func1.1
	/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:685
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1337"
        }
    ]
}
»
2

这个报错是在 Dump 全量导出时出现的，不能使用 sql-skip 跳过，方便的话可以发一下 task 配置文件

3 
name: "syncspot"
task-mode: "all"
target-database:
  host: "1.1.1.1"
  port: 3306
  user: "tidb_syncer"
  password: "XPAAAAAXPAAAAA=="
mysql-instances:
  - source-id: "mysql-replica-01"
  black-white-list: "global"

black-white-list:
  global:
    ignore-dbs: ["mysql","information_schema","performance_schema"]

这是task.yaml文件，请帮忙看一下，谢谢:pray:

4

请问有什么建议吗？

5

可以看下 dump 数据的操作是不是有什么异常，看报错是 mysql-bin.010603 文件的 binlog 内容有问题。