[Fix](job) fix drop db error and duplicate fragment_id when retry #57307

JNSimba · 2025-10-24T07:31:34Z

What problem does this PR solve?

Fixed the following issues:

In a cloud environment, if the database has been deleted, attempting to drop a job would result in an error.
In a cloud environment, MS offsets were not successfully put, and statistics were inaccurate.
When a StreamingTask timed out and retried, a duplicate framement error would be reported.

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

hello-stephen · 2025-10-24T07:31:41Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

JNSimba · 2025-10-24T07:36:08Z

run buildall

doris-robot · 2025-10-24T08:13:29Z

ClickBench: Total hot run time: 28.03 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cdf0fdd8e25d0c611d477f0f237187f9244180ea, data reload: false

query1	0.06	0.06	0.05
query2	0.09	0.06	0.06
query3	0.26	0.08	0.08
query4	1.61	0.11	0.11
query5	0.28	0.26	0.25
query6	1.19	0.65	0.65
query7	0.03	0.03	0.03
query8	0.05	0.05	0.05
query9	0.63	0.53	0.52
query10	0.58	0.57	0.59
query11	0.16	0.12	0.12
query12	0.16	0.13	0.12
query13	0.61	0.61	0.61
query14	1.00	1.02	0.99
query15	0.85	0.84	0.86
query16	0.39	0.40	0.39
query17	1.02	1.04	1.01
query18	0.21	0.20	0.20
query19	1.95	1.84	1.84
query20	0.01	0.01	0.02
query21	15.44	0.17	0.12
query22	5.14	0.07	0.04
query23	15.67	0.26	0.10
query24	2.66	0.86	0.82
query25	0.08	0.08	0.07
query26	0.14	0.14	0.12
query27	0.08	0.06	0.05
query28	5.15	1.13	0.93
query29	12.68	3.94	3.27
query30	0.28	0.14	0.12
query31	2.82	0.60	0.38
query32	3.23	0.55	0.46
query33	3.01	3.13	3.08
query34	15.83	5.15	4.54
query35	4.62	4.58	4.56
query36	0.66	0.52	0.49
query37	0.11	0.08	0.07
query38	0.07	0.05	0.04
query39	0.04	0.03	0.03
query40	0.19	0.15	0.14
query41	0.09	0.04	0.04
query42	0.04	0.03	0.03
query43	0.05	0.04	0.03
Total cold run time: 99.22 s
Total hot run time: 28.03 s

JNSimba · 2025-10-24T09:30:04Z

run buildall

doris-robot · 2025-10-24T10:14:40Z

ClickBench: Total hot run time: 27.97 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a77af216a0a1e32728689f9b5ab620a078ce6207, data reload: false

query1	0.06	0.06	0.05
query2	0.09	0.06	0.06
query3	0.25	0.08	0.09
query4	1.60	0.12	0.12
query5	0.29	0.27	0.26
query6	1.20	0.67	0.66
query7	0.03	0.03	0.03
query8	0.05	0.05	0.04
query9	0.62	0.55	0.55
query10	0.60	0.59	0.62
query11	0.17	0.11	0.12
query12	0.15	0.12	0.13
query13	0.62	0.61	0.59
query14	1.03	1.02	1.02
query15	0.87	0.84	0.88
query16	0.41	0.43	0.41
query17	1.07	1.09	1.07
query18	0.22	0.21	0.20
query19	1.92	1.88	1.87
query20	0.02	0.01	0.01
query21	15.40	0.18	0.13
query22	5.04	0.08	0.05
query23	15.66	0.27	0.11
query24	2.99	0.75	0.29
query25	0.07	0.08	0.07
query26	0.15	0.14	0.15
query27	0.07	0.06	0.05
query28	4.18	1.16	0.98
query29	12.56	4.12	3.44
query30	0.30	0.15	0.12
query31	2.82	0.63	0.40
query32	3.25	0.56	0.48
query33	3.10	3.06	3.22
query34	15.80	5.18	4.53
query35	4.60	4.62	4.56
query36	0.70	0.53	0.51
query37	0.10	0.07	0.06
query38	0.07	0.05	0.04
query39	0.04	0.04	0.03
query40	0.19	0.16	0.14
query41	0.10	0.04	0.04
query42	0.05	0.03	0.03
query43	0.05	0.04	0.03
Total cold run time: 98.56 s
Total hot run time: 27.97 s

JNSimba · 2025-10-24T10:53:38Z

run buildall

doris-robot · 2025-10-24T11:28:32Z

TPC-DS: Total hot run time: 190868 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a77af216a0a1e32728689f9b5ab620a078ce6207, data reload: false

query1	1064	438	407	407
query2	6578	1714	1709	1709
query3	6761	222	223	222
query4	26385	23429	23160	23160
query5	4471	643	520	520
query6	361	269	241	241
query7	4653	504	307	307
query8	314	264	273	264
query9	8669	2596	2580	2580
query10	506	342	320	320
query11	15420	15064	14818	14818
query12	211	121	112	112
query13	1706	566	435	435
query14	12002	9601	9616	9601
query15	267	208	178	178
query16	7812	676	488	488
query17	1657	811	701	701
query18	2089	462	370	370
query19	287	232	187	187
query20	147	138	130	130
query21	225	146	124	124
query22	4598	4891	4579	4579
query23	34879	33817	33954	33817
query24	8412	2527	2576	2527
query25	773	540	470	470
query26	1365	281	174	174
query27	2829	533	369	369
query28	4315	2246	2224	2224
query29	805	665	524	524
query30	310	242	199	199
query31	965	853	763	763
query32	90	81	75	75
query33	596	412	350	350
query34	860	891	548	548
query35	855	875	798	798
query36	961	1031	919	919
query37	131	119	115	115
query38	3694	3706	3595	3595
query39	1566	1480	1507	1480
query40	224	132	117	117
query41	64	59	59	59
query42	132	116	122	116
query43	493	493	478	478
query44	1240	738	751	738
query45	219	185	176	176
query46	910	1011	650	650
query47	1761	1797	1714	1714
query48	392	438	324	324
query49	784	496	434	434
query50	683	684	424	424
query51	3916	4002	4038	4002
query52	110	111	101	101
query53	240	272	198	198
query54	610	596	558	558
query55	93	90	88	88
query56	333	339	311	311
query57	1177	1204	1122	1122
query58	297	286	284	284
query59	2632	2580	2584	2580
query60	356	351	338	338
query61	158	156	161	156
query62	806	768	689	689
query63	239	203	202	202
query64	4391	1173	862	862
query65	4061	3972	4030	3972
query66	1093	442	333	333
query67	15544	14988	15025	14988
query68	9548	951	594	594
query69	506	331	290	290
query70	1347	1257	1239	1239
query71	538	345	326	326
query72	5631	4928	4841	4841
query73	703	601	361	361
query74	9255	9149	8644	8644
query75	4442	3314	2872	2872
query76	3720	1162	759	759
query77	966	410	324	324
query78	9574	9958	8887	8887
query79	1467	860	603	603
query80	685	583	518	518
query81	498	260	233	233
query82	460	165	142	142
query83	315	266	253	253
query84	305	113	108	108
query85	915	485	506	485
query86	340	298	304	298
query87	3738	3756	3705	3705
query88	2886	2275	2257	2257
query89	399	334	289	289
query90	2012	227	219	219
query91	160	166	139	139
query92	90	70	70	70
query93	1169	994	642	642
query94	707	435	366	366
query95	415	410	308	308
query96	505	592	290	290
query97	2962	2975	2860	2860
query98	241	233	219	219
query99	1444	1389	1313	1313
Total cold run time: 280490 ms
Total hot run time: 190868 ms

JNSimba · 2025-10-24T11:29:15Z

run p0

JNSimba · 2025-10-24T11:29:24Z

run cloud_p0

JNSimba · 2025-10-24T11:31:20Z

run nonConcurrent

JNSimba · 2025-10-24T11:32:33Z

run feut

doris-robot · 2025-10-24T11:33:39Z

ClickBench: Total hot run time: 27.67 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a77af216a0a1e32728689f9b5ab620a078ce6207, data reload: false

query1	0.06	0.04	0.05
query2	0.09	0.06	0.05
query3	0.25	0.08	0.08
query4	1.61	0.12	0.12
query5	0.28	0.28	0.24
query6	1.17	0.65	0.65
query7	0.03	0.03	0.03
query8	0.05	0.04	0.04
query9	0.64	0.52	0.52
query10	0.57	0.59	0.58
query11	0.16	0.11	0.12
query12	0.16	0.14	0.13
query13	0.62	0.60	0.61
query14	1.02	1.00	1.01
query15	0.87	0.83	0.84
query16	0.41	0.40	0.40
query17	1.05	1.02	1.07
query18	0.21	0.19	0.20
query19	1.85	1.81	1.79
query20	0.01	0.02	0.02
query21	15.47	0.18	0.12
query22	5.14	0.07	0.05
query23	15.69	0.26	0.10
query24	2.68	0.98	0.48
query25	0.09	0.05	0.05
query26	0.14	0.12	0.12
query27	0.07	0.06	0.06
query28	3.88	1.14	0.92
query29	12.58	3.98	3.27
query30	0.29	0.14	0.13
query31	2.81	0.58	0.38
query32	3.23	0.56	0.47
query33	2.97	3.10	3.05
query34	15.73	5.15	4.55
query35	4.58	4.62	4.62
query36	0.68	0.50	0.50
query37	0.10	0.07	0.07
query38	0.07	0.04	0.04
query39	0.04	0.03	0.02
query40	0.17	0.16	0.14
query41	0.09	0.03	0.03
query42	0.04	0.03	0.04
query43	0.04	0.03	0.04
Total cold run time: 97.69 s
Total hot run time: 27.67 s

JNSimba · 2025-10-24T12:08:57Z

run p0

hello-stephen · 2025-10-24T13:38:48Z

FE Regression Coverage Report

Increment line coverage 45.71% (32/70) 🎉
Increment coverage report
Complete coverage report

hello-stephen · 2025-10-24T13:48:25Z

FE Regression Coverage Report

Increment line coverage 75.71% (53/70) 🎉
Increment coverage report
Complete coverage report

JNSimba · 2025-10-24T14:00:42Z

run cloud_p0

hello-stephen · 2025-10-24T14:29:26Z

FE Regression Coverage Report

Increment line coverage 75.71% (53/70) 🎉
Increment coverage report
Complete coverage report

JNSimba · 2025-10-24T15:35:50Z

run buildall

doris-robot · 2025-10-24T16:04:58Z

TPC-DS: Total hot run time: 188155 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4ca777b05416c54c385c7550b292b0e5e0ebdd06, data reload: false

query1	1096	398	400	398
query2	6576	1717	1674	1674
query3	6755	226	221	221
query4	27115	23284	23721	23284
query5	5970	656	515	515
query6	484	261	238	238
query7	5897	510	308	308
query8	340	268	273	268
query9	9106	2600	2604	2600
query10	586	366	295	295
query11	16830	15126	14844	14844
query12	185	115	112	112
query13	1666	557	451	451
query14	12624	9649	9364	9364
query15	257	192	185	185
query16	7818	708	568	568
query17	1532	877	702	702
query18	2108	455	406	406
query19	333	224	191	191
query20	137	132	137	132
query21	231	149	121	121
query22	4611	4490	4402	4402
query23	34579	33674	33993	33674
query24	7939	2534	2538	2534
query25	709	529	478	478
query26	1367	298	169	169
query27	2815	538	372	372
query28	4447	2214	2220	2214
query29	939	636	524	524
query30	317	243	206	206
query31	883	853	782	782
query32	91	79	83	79
query33	606	400	344	344
query34	883	925	579	579
query35	884	899	800	800
query36	968	995	914	914
query37	123	112	90	90
query38	3549	3570	3459	3459
query39	1492	1412	1424	1412
query40	224	127	121	121
query41	61	59	58	58
query42	122	116	119	116
query43	488	503	493	493
query44	1253	767	737	737
query45	189	191	177	177
query46	889	1021	676	676
query47	1771	1808	1713	1713
query48	384	438	321	321
query49	777	534	400	400
query50	667	692	414	414
query51	3865	4038	3884	3884
query52	107	111	109	109
query53	242	271	195	195
query54	609	615	545	545
query55	92	82	87	82
query56	316	314	348	314
query57	1206	1201	1129	1129
query58	308	299	287	287
query59	2530	2971	2749	2749
query60	415	384	395	384
query61	217	208	201	201
query62	821	783	725	725
query63	249	209	214	209
query64	4708	1264	914	914
query65	4144	4145	4136	4136
query66	1015	452	366	366
query67	15662	15341	14841	14841
query68	9328	943	603	603
query69	534	319	285	285
query70	1349	1301	1237	1237
query71	548	346	319	319
query72	6011	2584	5446	2584
query73	906	781	369	369
query74	8890	9197	8660	8660
query75	4521	3315	2812	2812
query76	3808	1154	739	739
query77	810	420	316	316
query78	9613	9825	8847	8847
query79	1910	829	590	590
query80	768	581	518	518
query81	499	263	236	236
query82	444	170	137	137
query83	297	263	261	261
query84	298	113	100	100
query85	858	481	441	441
query86	332	310	306	306
query87	3700	3787	3615	3615
query88	3388	2235	2275	2235
query89	391	345	301	301
query90	2009	231	224	224
query91	169	168	132	132
query92	87	69	67	67
query93	1201	1015	646	646
query94	696	443	331	331
query95	407	335	320	320
query96	498	570	287	287
query97	2982	2991	2902	2902
query98	251	211	214	211
query99	1453	1400	1319	1319
Total cold run time: 287135 ms
Total hot run time: 188155 ms

doris-robot · 2025-10-24T16:10:05Z

ClickBench: Total hot run time: 27.77 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4ca777b05416c54c385c7550b292b0e5e0ebdd06, data reload: false

query1	0.06	0.06	0.05
query2	0.09	0.05	0.05
query3	0.26	0.08	0.08
query4	1.60	0.12	0.12
query5	0.28	0.25	0.25
query6	1.17	0.65	0.64
query7	0.03	0.03	0.03
query8	0.06	0.05	0.05
query9	0.63	0.52	0.52
query10	0.59	0.58	0.57
query11	0.16	0.12	0.12
query12	0.16	0.12	0.13
query13	0.62	0.60	0.60
query14	1.01	1.02	0.99
query15	0.85	0.84	0.85
query16	0.40	0.39	0.38
query17	1.04	1.05	1.05
query18	0.22	0.20	0.20
query19	1.99	1.82	1.81
query20	0.01	0.01	0.01
query21	15.47	0.18	0.13
query22	5.19	0.08	0.05
query23	15.65	0.27	0.11
query24	2.62	0.47	0.41
query25	0.07	0.07	0.05
query26	0.14	0.13	0.13
query27	0.07	0.06	0.06
query28	4.16	1.16	0.93
query29	12.55	4.00	3.38
query30	0.28	0.14	0.12
query31	2.82	0.60	0.38
query32	3.22	0.54	0.46
query33	3.17	3.11	3.07
query34	15.91	5.17	4.54
query35	4.57	4.61	4.60
query36	0.68	0.50	0.49
query37	0.11	0.07	0.07
query38	0.07	0.04	0.04
query39	0.04	0.03	0.04
query40	0.17	0.15	0.15
query41	0.09	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 98.36 s
Total hot run time: 27.77 s

hello-stephen · 2025-10-24T16:35:38Z

FE UT Coverage Report

Increment line coverage 7.69% (6/78) 🎉
Increment coverage report
Complete coverage report

JNSimba · 2025-10-25T13:47:47Z

run buildall

doris-robot · 2025-10-25T14:23:31Z

ClickBench: Total hot run time: 28.01 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1e998795ca0ee7abe1feb3f5f17bb1d204fc9486, data reload: false

query1	0.06	0.05	0.05
query2	0.09	0.06	0.06
query3	0.25	0.08	0.08
query4	1.61	0.12	0.11
query5	0.29	0.26	0.24
query6	1.16	0.66	0.65
query7	0.04	0.03	0.03
query8	0.05	0.04	0.04
query9	0.64	0.55	0.53
query10	0.59	0.58	0.57
query11	0.17	0.11	0.12
query12	0.15	0.13	0.13
query13	0.62	0.61	0.63
query14	1.02	1.02	1.01
query15	0.85	0.86	0.83
query16	0.41	0.38	0.40
query17	1.02	1.02	1.01
query18	0.23	0.20	0.21
query19	1.89	1.86	1.89
query20	0.02	0.01	0.01
query21	15.44	0.22	0.13
query22	4.92	0.08	0.05
query23	15.66	0.26	0.10
query24	2.65	0.70	1.13
query25	0.07	0.05	0.05
query26	0.15	0.14	0.13
query27	0.06	0.05	0.06
query28	4.35	1.17	0.93
query29	12.62	4.00	3.30
query30	0.29	0.14	0.12
query31	2.82	0.59	0.40
query32	3.24	0.55	0.48
query33	3.01	3.03	3.05
query34	15.93	5.12	4.56
query35	4.61	4.58	4.62
query36	0.68	0.50	0.50
query37	0.10	0.07	0.07
query38	0.07	0.05	0.04
query39	0.04	0.04	0.03
query40	0.18	0.15	0.15
query41	0.09	0.03	0.03
query42	0.05	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 98.23 s
Total hot run time: 28.01 s

JNSimba · 2025-10-25T15:06:43Z

run buildall

doris-robot · 2025-10-25T15:55:52Z

TPC-DS: Total hot run time: 187289 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b975c1fd44989dc78668c62e33ad5eb24cc7ec3e, data reload: false

query1	1084	431	401	401
query2	6562	1679	1688	1679
query3	6746	220	232	220
query4	26772	23845	23090	23090
query5	5223	661	497	497
query6	353	257	232	232
query7	4667	507	307	307
query8	332	269	272	269
query9	8696	2598	2596	2596
query10	529	325	300	300
query11	16074	15431	14822	14822
query12	178	125	121	121
query13	1670	575	437	437
query14	11777	9192	9322	9192
query15	210	199	175	175
query16	7655	671	509	509
query17	1373	772	632	632
query18	2275	464	376	376
query19	236	239	188	188
query20	137	128	144	128
query21	246	141	124	124
query22	4645	4695	4647	4647
query23	34914	33625	33807	33625
query24	8435	2497	2565	2497
query25	595	546	482	482
query26	1257	279	178	178
query27	3149	534	351	351
query28	4434	2245	2199	2199
query29	839	678	510	510
query30	316	250	215	215
query31	931	910	801	801
query32	84	76	77	76
query33	629	377	322	322
query34	807	859	550	550
query35	802	853	755	755
query36	937	1009	902	902
query37	129	106	85	85
query38	3479	3516	3491	3491
query39	1471	1412	1442	1412
query40	219	134	122	122
query41	65	61	63	61
query42	120	123	113	113
query43	480	509	485	485
query44	1230	748	743	743
query45	193	193	176	176
query46	892	978	649	649
query47	1797	1797	1735	1735
query48	407	423	327	327
query49	782	539	436	436
query50	669	681	425	425
query51	3851	3981	3954	3954
query52	112	115	103	103
query53	254	295	196	196
query54	607	587	550	550
query55	91	86	90	86
query56	340	322	332	322
query57	1174	1201	1120	1120
query58	285	280	269	269
query59	2668	2582	2540	2540
query60	361	348	332	332
query61	165	157	156	156
query62	793	713	677	677
query63	231	197	198	197
query64	4418	1187	839	839
query65	4033	3947	3955	3947
query66	1076	438	350	350
query67	15408	15372	14867	14867
query68	8292	893	602	602
query69	500	337	294	294
query70	1363	1308	1266	1266
query71	496	336	330	330
query72	5552	2604	5331	2604
query73	775	758	370	370
query74	9114	9038	8735	8735
query75	3893	3418	2793	2793
query76	3532	1155	755	755
query77	785	407	324	324
query78	9541	9738	8888	8888
query79	2351	848	598	598
query80	642	562	523	523
query81	488	260	228	228
query82	447	163	132	132
query83	302	271	249	249
query84	301	110	101	101
query85	878	491	434	434
query86	333	305	309	305
query87	3706	3748	3600	3600
query88	3206	2309	2252	2252
query89	399	322	298	298
query90	2035	221	215	215
query91	166	165	136	136
query92	82	79	65	65
query93	1496	958	646	646
query94	697	455	350	350
query95	407	318	307	307
query96	493	591	287	287
query97	2952	3017	2898	2898
query98	250	215	210	210
query99	1442	1429	1324	1324
Total cold run time: 280285 ms
Total hot run time: 187289 ms

doris-robot · 2025-10-25T16:01:00Z

ClickBench: Total hot run time: 27.76 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b975c1fd44989dc78668c62e33ad5eb24cc7ec3e, data reload: false

query1	0.05	0.05	0.05
query2	0.09	0.06	0.07
query3	0.25	0.08	0.08
query4	1.60	0.12	0.12
query5	0.27	0.27	0.25
query6	1.18	0.65	0.64
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.64	0.53	0.51
query10	0.57	0.58	0.59
query11	0.17	0.12	0.12
query12	0.16	0.15	0.12
query13	0.61	0.62	0.61
query14	1.01	1.02	1.00
query15	0.85	0.85	0.85
query16	0.42	0.39	0.39
query17	1.03	1.01	1.02
query18	0.21	0.20	0.20
query19	1.90	1.80	1.80
query20	0.02	0.01	0.02
query21	15.45	0.21	0.13
query22	5.02	0.08	0.05
query23	15.65	0.27	0.11
query24	2.57	0.54	0.89
query25	0.08	0.06	0.07
query26	0.14	0.13	0.14
query27	0.09	0.05	0.05
query28	4.53	1.16	0.96
query29	12.56	3.98	3.33
query30	0.28	0.14	0.12
query31	2.84	0.60	0.38
query32	3.23	0.54	0.47
query33	3.02	3.01	3.08
query34	15.83	5.19	4.56
query35	4.60	4.56	4.58
query36	0.68	0.53	0.49
query37	0.10	0.06	0.06
query38	0.06	0.04	0.03
query39	0.04	0.03	0.03
query40	0.17	0.14	0.14
query41	0.09	0.03	0.02
query42	0.04	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 98.22 s
Total hot run time: 27.76 s

JNSimba · 2025-10-25T16:20:06Z

run buildall

doris-robot · 2025-10-25T16:59:06Z

ClickBench: Total hot run time: 27.78 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 89100ecc81f6981dfebca93041b19645c138c1c1, data reload: false

query1	0.05	0.05	0.05
query2	0.10	0.05	0.06
query3	0.25	0.08	0.08
query4	1.61	0.11	0.12
query5	0.27	0.26	0.26
query6	1.17	0.67	0.65
query7	0.04	0.03	0.03
query8	0.05	0.05	0.04
query9	0.62	0.53	0.54
query10	0.59	0.58	0.58
query11	0.16	0.12	0.15
query12	0.16	0.12	0.12
query13	0.63	0.60	0.61
query14	1.00	1.02	1.02
query15	0.86	0.82	0.83
query16	0.41	0.41	0.41
query17	1.02	1.07	1.06
query18	0.22	0.20	0.20
query19	1.92	1.89	1.81
query20	0.01	0.02	0.01
query21	15.46	0.20	0.13
query22	5.15	0.08	0.05
query23	15.70	0.24	0.10
query24	1.92	1.24	0.51
query25	0.09	0.06	0.06
query26	0.15	0.14	0.14
query27	0.06	0.06	0.05
query28	4.88	1.15	0.94
query29	12.60	4.00	3.30
query30	0.28	0.14	0.11
query31	2.82	0.57	0.38
query32	3.23	0.55	0.47
query33	2.99	3.06	3.02
query34	15.84	5.10	4.52
query35	4.58	4.58	4.61
query36	0.69	0.50	0.50
query37	0.09	0.06	0.06
query38	0.06	0.05	0.04
query39	0.04	0.03	0.03
query40	0.19	0.15	0.15
query41	0.09	0.03	0.04
query42	0.04	0.04	0.03
query43	0.04	0.04	0.03
Total cold run time: 98.13 s
Total hot run time: 27.78 s

hello-stephen · 2025-10-25T19:29:08Z

FE Regression Coverage Report

Increment line coverage 78.43% (80/102) 🎉
Increment coverage report
Complete coverage report

...-core/src/main/java/org/apache/doris/job/extensions/insert/streaming/StreamingInsertJob.java

hello-stephen · 2025-10-26T05:48:22Z

FE Regression Coverage Report

Increment line coverage 78.43% (80/102) 🎉
Increment coverage report
Complete coverage report

JNSimba · 2025-10-27T02:00:33Z

run buildall

doris-robot · 2025-10-27T02:49:10Z

ClickBench: Total hot run time: 28.34 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 72d33a53af2c882ba077c6cdf0d1be415098927e, data reload: false

query1	0.06	0.06	0.05
query2	0.10	0.06	0.06
query3	0.26	0.09	0.09
query4	1.62	0.12	0.11
query5	0.29	0.26	0.26
query6	1.20	0.66	0.67
query7	0.03	0.03	0.03
query8	0.05	0.05	0.05
query9	0.64	0.54	0.53
query10	0.59	0.59	0.58
query11	0.18	0.11	0.12
query12	0.16	0.12	0.12
query13	0.64	0.62	0.61
query14	1.02	1.03	1.03
query15	0.87	0.86	0.86
query16	0.40	0.40	0.40
query17	1.04	1.06	1.05
query18	0.22	0.21	0.21
query19	1.96	1.86	1.89
query20	0.02	0.01	0.02
query21	15.43	0.20	0.13
query22	5.10	0.07	0.05
query23	15.70	0.28	0.10
query24	3.28	1.34	0.78
query25	0.08	0.06	0.07
query26	0.14	0.15	0.13
query27	0.07	0.06	0.06
query28	5.46	1.15	0.94
query29	12.56	4.08	3.34
query30	0.28	0.14	0.12
query31	2.82	0.61	0.40
query32	3.25	0.57	0.48
query33	3.14	3.17	3.09
query34	15.95	5.18	4.53
query35	4.63	4.63	4.55
query36	0.68	0.52	0.51
query37	0.10	0.07	0.08
query38	0.07	0.05	0.04
query39	0.04	0.04	0.03
query40	0.18	0.16	0.15
query41	0.09	0.03	0.03
query42	0.04	0.04	0.03
query43	0.05	0.04	0.05
Total cold run time: 100.49 s
Total hot run time: 28.34 s

hello-stephen · 2025-10-27T05:05:41Z

FE Regression Coverage Report

Increment line coverage 77.08% (74/96) 🎉
Increment coverage report
Complete coverage report

JNSimba · 2025-10-27T06:24:25Z

run buildall

doris-robot · 2025-10-27T07:49:23Z

TPC-DS: Total hot run time: 190159 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9109794dbe6d81426558097684c224a5a0f2bacd, data reload: false

query1	1101	398	402	398
query2	6573	1757	1742	1742
query3	6758	226	238	226
query4	26378	23438	23876	23438
query5	4817	628	495	495
query6	352	246	236	236
query7	4684	504	298	298
query8	315	267	270	267
query9	8713	2565	2603	2565
query10	498	334	276	276
query11	15274	15138	14781	14781
query12	179	115	114	114
query13	1683	551	429	429
query14	10705	9315	9360	9315
query15	217	191	183	183
query16	7617	684	519	519
query17	1186	761	617	617
query18	2014	422	332	332
query19	238	270	217	217
query20	145	129	139	129
query21	233	138	127	127
query22	4778	4889	4417	4417
query23	34487	33822	33991	33822
query24	8621	2517	2572	2517
query25	648	569	514	514
query26	1266	280	166	166
query27	2885	517	389	389
query28	4478	2224	2203	2203
query29	859	651	498	498
query30	312	238	203	203
query31	919	870	822	822
query32	89	72	70	70
query33	578	411	388	388
query34	835	872	533	533
query35	838	873	777	777
query36	983	1036	933	933
query37	130	116	93	93
query38	3713	3705	3601	3601
query39	1524	1400	1421	1400
query40	235	124	123	123
query41	70	58	56	56
query42	118	117	110	110
query43	483	493	489	489
query44	1213	746	736	736
query45	186	176	176	176
query46	869	992	633	633
query47	1737	1821	1691	1691
query48	381	428	307	307
query49	769	512	427	427
query50	638	681	408	408
query51	3902	3902	3872	3872
query52	102	109	101	101
query53	236	268	193	193
query54	600	607	525	525
query55	92	93	87	87
query56	354	309	313	309
query57	1149	1185	1110	1110
query58	282	286	273	273
query59	2530	2625	2510	2510
query60	360	355	328	328
query61	164	157	165	157
query62	790	736	658	658
query63	242	199	194	194
query64	4407	1165	866	866
query65	4046	3953	3981	3953
query66	1128	428	334	334
query67	15493	15308	15063	15063
query68	8790	881	596	596
query69	513	331	289	289
query70	1378	1305	1261	1261
query71	508	350	316	316
query72	6034	5023	4923	4923
query73	726	573	365	365
query74	8796	8776	8730	8730
query75	4183	3330	2871	2871
query76	3755	1145	723	723
query77	833	389	325	325
query78	9480	9863	8889	8889
query79	2157	856	594	594
query80	653	583	499	499
query81	513	265	234	234
query82	457	172	132	132
query83	273	270	256	256
query84	256	115	94	94
query85	911	501	438	438
query86	396	322	308	308
query87	3783	3707	3663	3663
query88	3496	2268	2250	2250
query89	384	333	290	290
query90	1931	217	234	217
query91	169	188	151	151
query92	83	70	70	70
query93	1608	995	644	644
query94	691	416	347	347
query95	414	335	302	302
query96	493	568	280	280
query97	2934	2986	2858	2858
query98	252	210	218	210
query99	1563	1420	1295	1295
Total cold run time: 278612 ms
Total hot run time: 190159 ms

doris-robot · 2025-10-27T07:54:30Z

ClickBench: Total hot run time: 27.55 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9109794dbe6d81426558097684c224a5a0f2bacd, data reload: false

query1	0.05	0.05	0.05
query2	0.09	0.05	0.06
query3	0.26	0.09	0.09
query4	1.61	0.12	0.13
query5	0.28	0.27	0.27
query6	1.18	0.67	0.65
query7	0.03	0.03	0.03
query8	0.06	0.04	0.04
query9	0.64	0.53	0.51
query10	0.57	0.58	0.57
query11	0.17	0.12	0.11
query12	0.16	0.12	0.12
query13	0.62	0.60	0.61
query14	1.04	1.02	1.00
query15	0.84	0.83	0.87
query16	0.38	0.40	0.40
query17	1.05	1.05	1.00
query18	0.21	0.20	0.20
query19	1.90	1.86	1.81
query20	0.02	0.01	0.01
query21	15.45	0.19	0.13
query22	5.10	0.07	0.05
query23	15.66	0.26	0.11
query24	2.29	1.24	0.33
query25	0.08	0.06	0.05
query26	0.14	0.13	0.14
query27	0.07	0.06	0.06
query28	4.11	1.14	0.94
query29	12.55	4.04	3.30
query30	0.28	0.14	0.11
query31	2.82	0.60	0.38
query32	3.23	0.56	0.46
query33	3.03	3.10	3.08
query34	15.82	5.21	4.54
query35	4.61	4.58	4.58
query36	0.67	0.50	0.49
query37	0.10	0.07	0.07
query38	0.07	0.04	0.04
query39	0.03	0.03	0.03
query40	0.17	0.13	0.13
query41	0.08	0.03	0.03
query42	0.04	0.03	0.02
query43	0.05	0.04	0.03
Total cold run time: 97.61 s
Total hot run time: 27.55 s

liaoxin01

LGTM

github-actions · 2025-10-27T10:14:33Z

PR approved by at least one committer and no changes requested.

github-actions · 2025-10-27T10:14:36Z

PR approved by anyone and no changes requested.

hello-stephen · 2025-10-27T10:26:20Z

FE Regression Coverage Report

Increment line coverage 77.08% (74/96) 🎉
Increment coverage report
Complete coverage report

sollhui

LGTM

…7307) ### What problem does this PR solve? Fixed the following issues: 1. In a cloud environment, if the database has been deleted, attempting to drop a job would result in an error. 2. In a cloud environment, MS offsets were not successfully put, and statistics were inaccurate. 3. When a StreamingTask timed out and retried, a duplicate framement error would be reported.

…en retry #57307 (#57375) Cherry-picked from #57307 Co-authored-by: wudi <[email protected]>

fix drop db error and duplicate queryid

cdf0fdd

JNSimba changed the title ~~[Fix](job) fix drop db error and duplicate queryid when retry~~ [Fix](job) fix drop db error and duplicate fragment_id when retry Oct 24, 2025

fix

a77af21

add log

4ca777b

add log 2

1e99879

fix

b975c1f

fix

89100ec

liaoxin01 reviewed Oct 26, 2025

View reviewed changes

...-core/src/main/java/org/apache/doris/job/extensions/insert/streaming/StreamingInsertJob.java Outdated Show resolved Hide resolved

liaoxin01 added the dev/4.0.x label Oct 26, 2025

fix

72d33a5

fix

9109794

liaoxin01 approved these changes Oct 27, 2025

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Oct 27, 2025

github-actions bot added the reviewed label Oct 27, 2025

sollhui approved these changes Oct 27, 2025

View reviewed changes

JNSimba merged commit 870a134 into apache:master Oct 27, 2025
27 of 28 checks passed

github-actions bot mentioned this pull request Oct 27, 2025

branch-4.0: [Fix](job) fix drop db error and duplicate fragment_id when retry #57307 #57375

Merged

yiguolei pushed a commit that referenced this pull request Oct 28, 2025

branch-4.0: [Fix](job) fix drop db error and duplicate fragment_id wh…

4dc38ad

…en retry #57307 (#57375) Cherry-picked from #57307 Co-authored-by: wudi <[email protected]>

yiguolei added dev/4.0.1-merged and removed dev/4.0.x labels Oct 28, 2025

[Fix](job) fix drop db error and duplicate fragment_id when retry #57307

[Fix](job) fix drop db error and duplicate fragment_id when retry #57307

Uh oh!

Conversation

JNSimba commented Oct 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

hello-stephen commented Oct 24, 2025

Uh oh!

JNSimba commented Oct 24, 2025

Uh oh!

doris-robot commented Oct 24, 2025

Uh oh!

JNSimba commented Oct 24, 2025

Uh oh!

doris-robot commented Oct 24, 2025

Uh oh!

JNSimba commented Oct 24, 2025

Uh oh!

doris-robot commented Oct 24, 2025

Uh oh!

JNSimba commented Oct 24, 2025

Uh oh!

JNSimba commented Oct 24, 2025

Uh oh!

JNSimba commented Oct 24, 2025

Uh oh!

JNSimba commented Oct 24, 2025

Uh oh!

doris-robot commented Oct 24, 2025

Uh oh!

JNSimba commented Oct 24, 2025

Uh oh!

hello-stephen commented Oct 24, 2025

FE Regression Coverage Report

Uh oh!

hello-stephen commented Oct 24, 2025

FE Regression Coverage Report

Uh oh!

JNSimba commented Oct 24, 2025

Uh oh!

hello-stephen commented Oct 24, 2025

FE Regression Coverage Report

Uh oh!

JNSimba commented Oct 24, 2025

Uh oh!

doris-robot commented Oct 24, 2025

Uh oh!

doris-robot commented Oct 24, 2025

Uh oh!

hello-stephen commented Oct 24, 2025

FE UT Coverage Report

Uh oh!

JNSimba commented Oct 25, 2025

Uh oh!

doris-robot commented Oct 25, 2025

Uh oh!

JNSimba commented Oct 25, 2025

Uh oh!

doris-robot commented Oct 25, 2025

Uh oh!

doris-robot commented Oct 25, 2025

Uh oh!

JNSimba commented Oct 25, 2025

Uh oh!

doris-robot commented Oct 25, 2025

Uh oh!

hello-stephen commented Oct 25, 2025

FE Regression Coverage Report

Uh oh!

Uh oh!

hello-stephen commented Oct 26, 2025

FE Regression Coverage Report

Uh oh!

JNSimba commented Oct 27, 2025

Uh oh!

JNSimba commented Oct 24, 2025 •

edited

Loading