【TiDB 使用环境】生产环境
【TiDB 版本】8.5.3
请教社区各位大佬，这是什么原因导致的，排查日志后，有如下提示，重启后TiFlash日志显示正常，但是查询还是出现TiFlash server timeout
[2025/11/18 03:41:53.865 +08:00] [WARN] [Task.cpp:128] [“error occurred and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763408231933272790, local_query_id:3046069, server_id:909, start_ts:462266887779647521,task_id:9> 0”] [thread_id=1118]
[2025/11/18 03:41:53.865 +08:00] [WARN] [MPPTaskManager.cpp:289] [“Begin to abort gather: gather_id:1, query_ts:1763408231933272790, local_query_id:3046069, server_id:909, start_ts:462266887779647521, abort type: ONCANCELLATION, reason: Receive cancel request from TiDB”] [thread_id=37886]
[2025/11/18 03:41:53.865 +08:00] [WARN] [Task.cpp:128] [“error occurred and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763408231933272790, local_query_id:3046069, server_id:909, start_ts:462266887779647521,task_id:9> 0”] [thread_id=1107]
[2025/11/18 03:41:53.865 +08:00] [WARN] [MPPTaskManager.cpp:333] ["Remaining task in gather gather_id:1, query_ts:1763408231933272790, local_query_id:3046069, server_id:909, start_ts:462266887779647521 are: MPP<gather_id:1, query_ts:1763408231933272790, local_query_id:3046069, server_id:909, start_ts:462266887779647521,task_id:9> "] [thread_id=37886]
[2025/11/18 03:41:53.865 +08:00] [WARN] [MPPTask.cpp:751] [“Begin abort task: MPP<gather_id:1, query_ts:1763408231933272790, local_query_id:3046069, server_id:909, start_ts:462266887779647521,task_id:9>, abort type: ONCANCELLATION”] [source=“MPP<gather_id:1, query_ts:1763408231933272790, local_query_id:3046069, server_id:909, start_ts:462266887779647521,task_id:9>”] [thread_id=37886]
[2025/11/18 03:41:53.866 +08:00] [WARN] [MPPTask.cpp:780] [“Finish abort task from running”] [source=“MPP<gather_id:1, query_ts:1763408231933272790, local_query_id:3046069, server_id:909, start_ts:462266887779647521,task_id:9>”] [thread_id=37886]
[2025/11/18 03:41:53.866 +08:00] [WARN] [MPPTaskManager.cpp:351] [“Finish abort gather: gather_id:1, query_ts:1763408231933272790, local_query_id:3046069, server_id:909, start_ts:462266887779647521”] [thread_id=37886]
[2025/11/18 03:41:53.866 +08:00] [WARN] [PipelineExecutorContext.cpp:104] [“error Receiver state: ERROR, error message: Exchange receiver meet error : Code: 0, e.displayText() = DB::Exception: Region epoch not match after retries: Region {518189,9835,7091} not in region cache., e.what() = DB::Exception, occured and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763408231933272790, local_query_id:3046069, server_id:909, start_ts:462266887779647521,task_id:9>”] [thread_id=1105]
[2025/11/18 03:41:53.878 +08:00] [WARN] [MPPTask.cpp:720] [“ReportMPPTaskStatus resp error: MppCoordinator not exists”] [source=“MPP<gather_id:1, query_ts:1763408231933272790, local_query_id:3046069, server_id:909, start_ts:462266887779647521,task_id:9>”] [thread_id=1235]
[2025/11/18 03:42:17.552 +08:00] [WARN] [CoprocessorHandler.cpp:221] [“RegionException: region_id=266278102, message: Region error NOT_FOUND(doCopLearnerRead)”] [source=“Coprocessor, is_remote_read: true, start_ts: 462266899261554718, region_info: {266278102, 9886, 7386}”] [thread_id=3601]
[2025/11/18 03:42:17.554 +08:00] [WARN] [] [“region {266278102,9886,7386} find error: region_not_found {\n region_id: 266278102\n}\n”] [source=pingcap.tikv] [thread_id=38220]
[2025/11/18 03:42:37.617 +08:00] [ERROR] [] [“coprocessor meets error, error message: {}, error code: {}”] [source=“MPP<gather_id:1, query_ts:1763408275728899239, local_query_id:3046083, server_id:909, start_ts:462266899261554718,task_id:2> pingcap/coprocessor”] [thread_id=38220]
[2025/11/18 03:42:37.619 +08:00] [WARN] [CoprocessorReaderSourceOp.cpp:78] [“coprocessor reader meets error: Region epoch not match after retries: Region {266278102,9889,7386} not in region cache.”] [source=“MPP<gather_id:1, query_ts:1763408275728899239, local_query_id:3046083, server_id:909, start_ts:462266899261554718,task_id:2>”] [thread_id=1106]
[2025/11/18 03:42:37.619 +08:00] [WARN] [Task.cpp:128] [“error occurred and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763408275728899239, local_query_id:3046083, server_id:909, start_ts:462266899261554718,task_id:2> 0”] [thread_id=1106]
[2025/11/18 03:42:37.620 +08:00] [WARN] [PipelineExecutorContext.cpp:104] [“error Region epoch not match after retries: Region {266278102,9889,7386} not in region cache. occured and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763408275728899239, local_query_id:3046083, server_id:909, start_ts:462266899261554718,task_id:2>”] [thread_id=1106]
[2025/11/18 03:42:37.621 +08:00] [WARN] [MPPTaskManager.cpp:289] [“Begin to abort gather: gather_id:1, query_ts:1763408275728899239, local_query_id:3046083, server_id:909, start_ts:462266899261554718, abort type: ONCANCELLATION, reason: Receive cancel request from TiDB”] [thread_id=3590]
[2025/11/18 03:42:37.622 +08:00] [WARN] [MPPTaskManager.cpp:333] ["Remaining task in gather gather_id:1, query_ts:1763408275728899239, local_query_id:3046083, server_id:909, start_ts:462266899261554718 are: MPP<gather_id:1, query_ts:1763408275728899239, local_query_id:3046083, server_id:909, start_ts:462266899261554718,task_id:2> "] [thread_id=3590]
[2025/11/18 03:42:37.622 +08:00] [WARN] [MPPTask.cpp:751] [“Begin abort task: MPP<gather_id:1, query_ts:1763408275728899239, local_query_id:3046083, server_id:909, start_ts:462266899261554718,task_id:2>, abort type: ONCANCELLATION”] [source=“MPP<gather_id:1, query_ts:1763408275728899239, local_query_id:3046083, server_id:909, start_ts:462266899261554718,task_id:2>”] [thread_id=3590]
[2025/11/18 03:42:37.622 +08:00] [WARN] [MPPTask.cpp:780] [“Finish abort task from running”] [source=“MPP<gather_id:1, query_ts:1763408275728899239, local_query_id:3046083, server_id:909, start_ts:462266899261554718,task_id:2>”] [thread_id=3590]
[2025/11/18 03:42:37.622 +08:00] [WARN] [MPPTaskManager.cpp:351] [“Finish abort gather: gather_id:1, query_ts:1763408275728899239, local_query_id:3046083, server_id:909, start_ts:462266899261554718”] [thread_id=3590]
[2025/11/18 03:42:37.629 +08:00] [WARN] [MPPTask.cpp:720] [“ReportMPPTaskStatus resp error: MppCoordinator not exists”] [source=“MPP<gather_id:1, query_ts:1763408275728899239, local_query_id:3046083, server_id:909, start_ts:462266899261554718,task_id:2>”] [thread_id=1764]
[2025/11/18 03:43:17.367 +08:00] [WARN] [CoprocessorHandler.cpp:221] [“RegionException: region_id=472378, message: Region error NOT_FOUND(doCopLearnerRead)”] [source=“Coprocessor, is_remote_read: true, start_ts: 462266914950873099, region_info: {472378, 9706, 7081}”] [thread_id=37946]
[2025/11/18 03:44:40.923 +08:00] [WARN] [MPPTaskManager.cpp:289] [“Begin to abort gather: gather_id:2, query_ts:1763408398139581036, local_query_id:3046111, server_id:909, start_ts:462266931347980315, abort type: ONCANCELLATION, reason: Receive cancel request from TiDB”] [thread_id=3587]
[2025/11/18 03:44:40.923 +08:00] [WARN] [MPPTaskManager.cpp:300] [“gather_id:2, query_ts:1763408398139581036, local_query_id:3046111, server_id:909, start_ts:462266931347980315 does not found in task manager, skip abort”] [thread_id=3587]
[2025/11/18 03:50:16.677 +08:00] [WARN] [CoprocessorHandler.cpp:221] [“RegionException: region_id=590056, message: Region error NOT_FOUND(doCopLearnerRead)”] [source=“Coprocessor, is_remote_read: true, start_ts: 462267024867852300, region_info: {590056, 9814, 7358}”] [thread_id=37278]
[2025/11/18 03:50:36.755 +08:00] [WARN] [MPPTaskManager.cpp:289] [“Begin to abort gather: gather_id:1, query_ts:1763408785501639037, local_query_id:145200, server_id:1426, start_ts:462267024867852300, abort type: ONCANCELLATION, reason: Receive cancel request from TiDB”] [thread_id=3579]
[2025/11/18 03:50:36.755 +08:00] [WARN] [MPPTaskManager.cpp:300] [“gather_id:1, query_ts:1763408785501639037, local_query_id:145200, server_id:1426, start_ts:462267024867852300 does not found in task manager, skip abort”] [thread_id=3579]
[2025/11/18 04:07:33.364 +08:00] [WARN] [CoprocessorHandler.cpp:221] [“RegionException: region_id=2418215, message: Region error NOT_FOUND(doCopLearnerRead)”] [source=“Coprocessor, is_remote_read: true, start_ts: 462267296619429962, region_info: {2418215, 9976, 7118}”] [thread_id=37903]
[2025/11/18 04:07:33.364 +08:00] [WARN] [] [“region {2418215,9976,7118} find error: region_not_found {\n region_id: 2418215\n}\n”] [source=pingcap.tikv] [thread_id=38223]
[2025/11/18 04:07:53.427 +08:00] [ERROR] [] [“coprocessor meets error, error message: {}, error code: {}”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:1> pingcap/coprocessor”] [thread_id=38223]
[2025/11/18 04:07:53.428 +08:00] [WARN] [CoprocessorReaderSourceOp.cpp:78] [“coprocessor reader meets error: Region epoch not match after retries: Region {2418215,9979,7118} not in region cache.”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:1>”] [thread_id=1108]
[2025/11/18 04:07:53.428 +08:00] [WARN] [Task.cpp:128] [“error occurred and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:1> 0”] [thread_id=1108]
[2025/11/18 04:07:53.429 +08:00] [WARN] [ExchangeReceiver.cpp:973] [“connection end. meet error: true, err msg: Code: 0, e.displayText() = DB::Exception: Region epoch not match after retries: Region {2418215,9979,7118} not in region cache., e.what() = DB::Exception, current alive connections: 0”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2> ExchangeReceiver_53 local tunnel1+2”] [thread_id=1108]
[2025/11/18 04:07:53.430 +08:00] [WARN] [ExchangeReceiver.cpp:994] [“Finish receiver channels, meet error: true, error message: Code: 0, e.displayText() = DB::Exception: Region epoch not match after retries: Region {2418215,9979,7118} not in region cache., e.what() = DB::Exception,”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2> ExchangeReceiver_53”] [thread_id=1108]
[2025/11/18 04:07:53.430 +08:00] [WARN] [ExchangeReceiverSourceOp.cpp:53] [“exchange receiver meets error: Receiver state: ERROR, error message: Code: 0, e.displayText() = DB::Exception: Region epoch not match after retries: Region {2418215,9979,7118} not in region cache., e.what() = DB::Exception,”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2>_ExchangeReceiver_ExchangeReceiver_53”] [thread_id=1104]
[2025/11/18 04:07:53.430 +08:00] [WARN] [ExchangeReceiverSourceOp.cpp:53] [“exchange receiver meets error: Receiver state: ERROR, error message: Code: 0, e.displayText() = DB::Exception: Region epoch not match after retries: Region {2418215,9979,7118} not in region cache., e.what() = DB::Exception,”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2>_ExchangeReceiver_ExchangeReceiver_53”] [thread_id=1107]
[2025/11/18 04:07:53.430 +08:00] [WARN] [ExchangeReceiverSourceOp.cpp:53] [“exchange receiver meets error: Receiver state: ERROR, error message: Code: 0, e.displayText() = DB::Exception: Region epoch not match after retries: Region {2418215,9979,7118} not in region cache., e.what() = DB::Exception,”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2>_ExchangeReceiver_ExchangeReceiver_53”] [thread_id=1102]
[2025/11/18 04:07:53.430 +08:00] [WARN] [ExchangeReceiverSourceOp.cpp:53] [“exchange receiver meets error: Receiver state: ERROR, error message: Code: 0, e.displayText() = DB::Exception: Region epoch not match after retries: Region {2418215,9979,7118} not in region cache., e.what() = DB::Exception,”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2>_ExchangeReceiver_ExchangeReceiver_53”] [thread_id=1118]
[2025/11/18 04:07:53.430 +08:00] [WARN] [ExchangeReceiverSourceOp.cpp:53] [“exchange receiver meets error: Receiver state: ERROR, error message: Code: 0, e.displayText() = DB::Exception: Region epoch not match after retries: Region {2418215,9979,7118} not in region cache., e.what() = DB::Exception,”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2>_ExchangeReceiver_ExchangeReceiver_53”] [thread_id=1106]
[2025/11/18 04:07:53.431 +08:00] [WARN] [ExchangeReceiverSourceOp.cpp:53] [“exchange receiver meets error: Receiver state: ERROR, error message: Code: 0, e.displayText() = DB::Exception: Region epoch not match after retries: Region {2418215,9979,7118} not in region cache., e.what() = DB::Exception,”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2>_ExchangeReceiver_ExchangeReceiver_53”] [thread_id=1105]
[2025/11/18 04:07:53.431 +08:00] [WARN] [ExchangeReceiverSourceOp.cpp:53] [“exchange receiver meets error: Receiver state: ERROR, error message: Code: 0, e.displayText() = DB::Exception: Region epoch not match after retries: Region {2418215,9979,7118} not in region cache., e.what() = DB::Exception,”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2>_ExchangeReceiver_ExchangeReceiver_53”] [thread_id=1103]
[2025/11/18 04:07:53.431 +08:00] [WARN] [Task.cpp:128] [“error occurred and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2> 0”] [thread_id=1103]
[2025/11/18 04:07:53.431 +08:00] [WARN] [Task.cpp:128] [“error occurred and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2> 0”] [thread_id=1107]
[2025/11/18 04:07:53.431 +08:00] [WARN] [Task.cpp:128] [“error occurred and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2> 0”] [thread_id=1102]
[2025/11/18 04:07:53.431 +08:00] [WARN] [Task.cpp:128] [“error occurred and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2> 0”] [thread_id=1118]
[2025/11/18 04:07:53.431 +08:00] [WARN] [Task.cpp:128] [“error occurred and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2> 0”] [thread_id=1106]
[2025/11/18 04:07:53.431 +08:00] [WARN] [Task.cpp:128] [“error occurred and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2> 0”] [thread_id=1105]
[2025/11/18 04:07:53.432 +08:00] [WARN] [PipelineExecutorContext.cpp:104] [“error Receiver state: ERROR, error message: Code: 0, e.displayText() = DB::Exception: Region epoch not match after retries: Region {2418215,9979,7118} not in region cache., e.what() = DB::Exception, occured and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2>”] [thread_id=1103]
[2025/11/18 04:07:53.432 +08:00] [WARN] [PipelineExecutorContext.cpp:104] [“error Region epoch not match after retries: Region {2418215,9979,7118} not in region cache. occured and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:1>”] [thread_id=1108]
[2025/11/18 04:07:53.432 +08:00] [WARN] [Task.cpp:128] [“error occurred and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2> 0”] [thread_id=1104]
[2025/11/18 04:07:53.439 +08:00] [WARN] [MPPTaskManager.cpp:289] [“Begin to abort gather: gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962, abort type: ONCANCELLATION, reason: Receive cancel request from TiDB”] [thread_id=37902]
[2025/11/18 04:07:53.439 +08:00] [WARN] [MPPTaskManager.cpp:333] ["Remaining task in gather gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962 are: MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2> MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:1> "] [thread_id=37902]
[2025/11/18 04:07:53.439 +08:00] [WARN] [MPPTask.cpp:751] [“Begin abort task: MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2>, abort type: ONCANCELLATION”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2>”] [thread_id=37902]
[2025/11/18 04:07:53.439 +08:00] [WARN] [MPPTask.cpp:780] [“Finish abort task from running”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:2>”] [thread_id=37902]
[2025/11/18 04:07:53.439 +08:00] [WARN] [MPPTask.cpp:751] [“Begin abort task: MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:1>, abort type: ONCANCELLATION”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:1>”] [thread_id=37902]
[2025/11/18 04:07:53.439 +08:00] [WARN] [MPPTask.cpp:780] [“Finish abort task from running”] [source=“MPP<gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962,task_id:1>”] [thread_id=37902]
[2025/11/18 04:07:53.439 +08:00] [WARN] [MPPTaskManager.cpp:351] [“Finish abort gather: gather_id:1, query_ts:1763409791546109002, local_query_id:3046347, server_id:909, start_ts:462267296619429962”] [thread_id=37902]
[2025/11/18 04:10:13.041 +08:00] [WARN] [CoprocessorHandler.cpp:221] [“RegionException: region_id=533355, message: Region error NOT_FOUND(doCopLearnerRead)”] [source=“Coprocessor, is_remote_read: true, start_ts: 462267338470457369, region_info: {533355, 9966, 7092}”] [thread_id=37904]
[2025/11/18 04:10:13.042 +08:00] [WARN] [] [“region {533355,9966,7092} find error: region_not_found {\n region_id: 533355\n}\n”] [source=pingcap.tikv] [thread_id=38224]
[2025/11/18 04:10:33.104 +08:00] [ERROR] [] [“coprocessor meets error, error message: {}, error code: {}”] [source=“MPP<gather_id:1, query_ts:1763409981830280019, local_query_id:145267, server_id:1426, start_ts:462267338470457369,task_id:3> pingcap/coprocessor”] [thread_id=38224]
[2025/11/18 04:10:33.105 +08:00] [WARN] [CoprocessorReaderSourceOp.cpp:78] [“coprocessor reader meets error: Region epoch not match after retries: Region {533355,9969,7093} not in region cache.”] [source=“MPP<gather_id:1, query_ts:1763409981830280019, local_query_id:145267, server_id:1426, start_ts:462267338470457369,task_id:3>”] [thread_id=1105]
[2025/11/18 04:10:33.106 +08:00] [WARN] [Task.cpp:128] [“error occurred and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763409981830280019, local_query_id:145267, server_id:1426, start_ts:462267338470457369,task_id:3> 0”] [thread_id=1105]
[2025/11/18 04:10:33.107 +08:00] [WARN] [PipelineExecutorContext.cpp:104] [“error Region epoch not match after retries: Region {533355,9969,7093} not in region cache. occured and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763409981830280019, local_query_id:145267, server_id:1426, start_ts:462267338470457369,task_id:3>”] [thread_id=1105]
[2025/11/18 04:10:33.116 +08:00] [WARN] [MPPTaskManager.cpp:289] [“Begin to abort gather: gather_id:1, query_ts:1763409981830280019, local_query_id:145267, server_id:1426, start_ts:462267338470457369, abort type: ONCANCELLATION, reason: Receive cancel request from TiDB”] [thread_id=1955]
[2025/11/18 04:10:33.116 +08:00] [WARN] [MPPTaskManager.cpp:333] ["Remaining task in gather gather_id:1, query_ts:1763409981830280019, local_query_id:145267, server_id:1426, start_ts:462267338470457369 are: MPP<gather_id:1, query_ts:1763409981830280019, local_query_id:145267, server_id:1426, start_ts:462267338470457369,task_id:3> "] [thread_id=1955]
[2025/11/18 04:10:33.116 +08:00] [WARN] [MPPTask.cpp:751] [“Begin abort task: MPP<gather_id:1, query_ts:1763409981830280019, local_query_id:145267, server_id:1426, start_ts:462267338470457369,task_id:3>, abort type: ONCANCELLATION”] [source=“MPP<gather_id:1, query_ts:1763409981830280019, local_query_id:145267, server_id:1426, start_ts:462267338470457369,task_id:3>”] [thread_id=1955]
[2025/11/18 04:10:33.116 +08:00] [WARN] [MPPTask.cpp:780] [“Finish abort task from running”] [source=“MPP<gather_id:1, query_ts:1763409981830280019, local_query_id:145267, server_id:1426, start_ts:462267338470457369,task_id:3>”] [thread_id=1955]
[2025/11/18 04:10:33.116 +08:00] [WARN] [MPPTaskManager.cpp:351] [“Finish abort gather: gather_id:1, query_ts:1763409981830280019, local_query_id:145267, server_id:1426, start_ts:462267338470457369”] [thread_id=1955]
[2025/11/18 04:11:44.691 +08:00] [ERROR] [] [“coprocessor meets error, error message: {}, error code: {}”] [source=“MPP<gather_id:1, query_ts:1763410022246565731, local_query_id:3046382, server_id:909, start_ts:462267357100245036,task_id:1> pingcap/coprocessor”] [thread_id=38225]
[2025/11/18 04:11:44.692 +08:00] [WARN] [CoprocessorReaderSourceOp.cpp:78] [“coprocessor reader meets error: region miss, region id is: 533355”] [source=“MPP<gather_id:1, query_ts:1763410022246565731, local_query_id:3046382, server_id:909, start_ts:462267357100245036,task_id:1>”] [thread_id=1103]
[2025/11/18 04:11:44.692 +08:00] [WARN] [Task.cpp:128] [“error occurred and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763410022246565731, local_query_id:3046382, server_id:909, start_ts:462267357100245036,task_id:1> 0”] [thread_id=1103]
[2025/11/18 04:11:44.693 +08:00] [WARN] [PipelineExecutorContext.cpp:104] [“error region miss, region id is: 533355 occured and cancel the query”] [source=“MPP<gather_id:1, query_ts:1763410022246565731, local_query_id:3046382, server_id:909, start_ts:462267357100245036,task_id:1>”] [thread_id=1103]
[2025/11/18 04:11:44.695 +08:00] [WARN] [MPPTaskManager.cpp:289] [“Begin to abort gather: gather_id:1, query_ts:1763410022246565731, local_query_id:3046382, server_id:909, start_ts:462267357100245036, abort type: ONCANCELLATION, reason: Receive cancel request from TiDB”] [thread_id=38011]
[2025/11/18 04:11:44.695 +08:00] [WARN] [MPPTaskManager.cpp:333] ["Remaining task in gather gather_id:1, query_ts:1763410022246565731, local_query_id:3046382, server_id:909, start_ts:462267357100245036 are: MPP<gather_id:1, query_ts:1763410022246565731, local_query_id:3046382, server_id:909, start_ts:462267357100245036,task_id:1> "] [thread_id=38011]
[2025/11/18 04:11:44.695 +08:00] [WARN] [MPPTask.cpp:751] [“Begin abort task: MPP<gather_id:1, query_ts:1763410022246565731, local_query_id:3046382, server_id:909, start_ts:462267357100245036,task_id:1>, abort type: ONCANCELLATION”] [source=“MPP<gather_id:1, query_ts:1763410022246565731, local_query_id:3046382, server_id:909, start_ts:462267357100245036,task_id:1>”] [thread_id=38011]
[2025/11/18 04:11:44.695 +08:00] [WARN] [MPPTask.cpp:780] [“Finish abort task from running”] [source=“MPP<gather_id:1, query_ts:1763410022246565731, local_query_id:3046382, server_id:909, start_ts:462267357100245036,task_id:1>”] [thread_id=38011]
[2025/11/18 04:11:44.695 +08:00] [WARN] [MPPTaskManager.cpp:351] [“Finish abort gather: gather_id:1, query_ts:1763410022246565731, local_query_id:3046382, server_id:909, start_ts:462267357100245036”] [thread_id=38011]
[2025/11/18 04:11:44.701 +08:00] [WARN] [MPPTask.cpp:720] [“ReportMPPTaskStatus resp error: MppCoordinator not exists”] [source=“MPP<gather_id:1, query_ts:1763410022246565731, local_query_id:3046382, server_id:909, start_ts:462267357100245036,task_id:1>”] [thread_id=1470]
[2025/11/18 04:17:17.728 +08:00] [WARN] [CoprocessorHandler.cpp:221] [“RegionException: region_id=233763231, message: Region error NOT_FOUND(doCopLearnerRead)”] [source=“Coprocessor, is_remote_read: true, start_ts: 462267449816383490, region_info: {233763231, 9708, 7082}”] [thread_id=37898]
[2025/11/18 04:25:52.968 +08:00] [WARN] [MPPTaskManager.cpp:289] [“Begin to abort gather: gather_id:1, query_ts:1763410871045178454, local_query_id:3046497, server_id:909, start_ts:462267579616985093, abort type: ONCANCELLATION, reason: Receive cancel request from TiDB”] [thread_id=37904]
[2025/11/18 04:25:52.970 +08:00] [WARN] [MPPTaskManager.cpp:300] [“gather_id:1, query_ts:1763410871045178454, local_query_id:3046497, server_id:909, start_ts:462267579616985093 does not found in task manager, skip abort”] [thread_id=37904]
可能是Region 元数据不一致：TiFlash 缓存的 Region 信息与 TiKV 实际状态不匹配，重试后仍无法获取有效 Region 数据
1 个赞
查询涉及的部分 Region（如 266278102、2418215 等）在 TiKV 中不存在或无法访问
大佬 重启后Tiflash Region元数据应该会重新获取吧 但是还是不行呢 有什么办法来解决吗
检查TiKV集群状态
- 使用TiDB的监控面板或使用
pd-ctl检查Region的健康状态，确认是否有Region处于异常状态（如pending peer、down peer等）。 - 检查TiKV日志，看是否有频繁的Region分裂或迁移。
1 个赞
检查TiFlash副本同步状态
- 通过SQL语句检查TiFlash副本的同步进度：
SELECT * FROM information_schema.tiflash_replica，查看PROGRESS列是否接近1。 - 如果同步延迟较大，需要分析原因，可能是由于写入压力大或TiFlash节点性能不足。
1 个赞
tiflash应该同步有问题，查下tiflash_replica看下
元数据损坏了吗？
平时tiflash是什么用途呢?