Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [fix](restore) Add a local snapshot lock to protect snapshot dir #47279 #47292

Open
wants to merge 1 commit into
base: branch-3.0
Choose a base branch
from

Conversation

github-actions[bot]
Copy link
Contributor

Cherry-picked from #47279

)

To avoid concurrent modification of a snapshot dir.
@github-actions github-actions bot requested a review from dataroaring as a code owner January 21, 2025 13:19
@Thearas
Copy link
Contributor

Thearas commented Jan 21, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Jan 21, 2025
@Thearas
Copy link
Contributor

Thearas commented Jan 21, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40943 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 62ce0fe663087a73a5e8e171c2a3a3391d65c824, data reload: false

------ Round 1 ----------------------------------
q1	17572	7436	7321	7321
q2	2075	172	161	161
q3	10753	1041	1164	1041
q4	10560	747	748	747
q5	7733	2851	2819	2819
q6	236	146	142	142
q7	977	615	608	608
q8	9588	1998	2059	1998
q9	6589	6391	6397	6391
q10	7010	2290	2338	2290
q11	469	255	255	255
q12	403	218	213	213
q13	17790	2990	3014	2990
q14	243	213	212	212
q15	559	526	531	526
q16	703	606	625	606
q17	971	576	600	576
q18	7284	6607	6715	6607
q19	1386	1052	1097	1052
q20	485	204	204	204
q21	3971	3228	3196	3196
q22	1088	1007	988	988
Total cold run time: 108445 ms
Total hot run time: 40943 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7248	7239	7236	7236
q2	327	247	237	237
q3	2872	2995	2922	2922
q4	2041	1854	1747	1747
q5	5737	5731	5741	5731
q6	230	139	146	139
q7	2273	1800	1826	1800
q8	3331	3581	3540	3540
q9	8820	8887	8860	8860
q10	3582	3534	3562	3534
q11	603	518	502	502
q12	760	570	605	570
q13	8853	3198	3211	3198
q14	304	268	273	268
q15	573	533	533	533
q16	709	678	649	649
q17	1861	1616	1559	1559
q18	8256	7784	7632	7632
q19	1645	1408	1643	1408
q20	2127	1894	1881	1881
q21	5534	5420	5256	5256
q22	1169	1076	1027	1027
Total cold run time: 68855 ms
Total hot run time: 60229 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197546 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 62ce0fe663087a73a5e8e171c2a3a3391d65c824, data reload: false

query1	1341	921	925	921
query2	6213	2103	2121	2103
query3	10822	4381	4212	4212
query4	66325	28849	23430	23430
query5	4899	456	463	456
query6	432	183	175	175
query7	5655	318	310	310
query8	314	229	225	225
query9	9340	2689	2681	2681
query10	458	270	253	253
query11	17471	15158	15664	15158
query12	166	102	102	102
query13	1531	436	425	425
query14	10642	7687	7511	7511
query15	207	183	181	181
query16	7114	504	522	504
query17	1064	604	596	596
query18	1934	316	331	316
query19	221	156	161	156
query20	118	110	113	110
query21	217	107	108	107
query22	4900	4525	4403	4403
query23	34865	34139	34244	34139
query24	6168	2964	2904	2904
query25	523	420	440	420
query26	658	178	173	173
query27	1859	364	374	364
query28	4365	2487	2447	2447
query29	684	450	424	424
query30	242	166	167	166
query31	995	828	849	828
query32	61	55	62	55
query33	441	290	273	273
query34	918	519	523	519
query35	835	750	731	731
query36	1087	975	978	975
query37	136	76	74	74
query38	4215	4033	4066	4033
query39	1541	1457	1469	1457
query40	206	97	100	97
query41	47	47	51	47
query42	112	102	100	100
query43	558	502	514	502
query44	1190	814	838	814
query45	187	172	174	172
query46	1161	710	740	710
query47	1987	1897	1896	1896
query48	490	383	388	383
query49	730	393	417	393
query50	857	432	427	427
query51	7400	7272	7165	7165
query52	98	86	85	85
query53	266	179	176	176
query54	554	444	447	444
query55	78	78	77	77
query56	258	246	244	244
query57	1204	1088	1088	1088
query58	209	218	215	215
query59	3140	3043	2964	2964
query60	277	252	249	249
query61	134	103	103	103
query62	793	657	666	657
query63	211	194	189	189
query64	1386	650	643	643
query65	3252	3174	3180	3174
query66	716	310	306	306
query67	15846	15510	15632	15510
query68	3953	599	578	578
query69	441	266	263	263
query70	1198	1134	1149	1134
query71	363	255	254	254
query72	6363	4006	4053	4006
query73	756	344	356	344
query74	10131	9265	9024	9024
query75	3367	2597	2669	2597
query76	1972	977	1140	977
query77	499	277	266	266
query78	10578	9566	9587	9566
query79	1658	572	600	572
query80	913	433	414	414
query81	513	253	235	235
query82	1259	132	113	113
query83	248	142	147	142
query84	286	89	77	77
query85	908	300	292	292
query86	342	303	254	254
query87	4535	4268	4358	4268
query88	3744	2414	2352	2352
query89	412	289	285	285
query90	2041	192	188	188
query91	200	146	146	146
query92	70	48	48	48
query93	1906	533	541	533
query94	881	307	293	293
query95	376	262	253	253
query96	620	277	288	277
query97	3335	3162	3181	3162
query98	214	203	198	198
query99	1590	1304	1288	1288
Total cold run time: 319996 ms
Total hot run time: 197546 ms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants