Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[feat](nereids) when check shape failed, print all plan with memo #45627

Merged
merged 6 commits into from
Dec 24, 2024
Merged

[feat](nereids) when check shape failed, print all plan with memo #45627

merged 6 commits into from
Dec 24, 2024

Conversation

englefly
Copy link
Contributor

@englefly englefly commented Dec 19, 2024 •
edited
Loading

What problem does this PR solve?

when check plan shape failed, print all plan and memo into log for debug

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@github-actions GitHub Actions
Copy link
Contributor

sh-checker report

To get the full details, please check in the job output.

shellcheck errors 

'shellcheck ' returned error 1 finding the following syntactical issues:

----------

In gensrc/script/gen_build_version.sh line 38:
if [[ ${build_version_hotfix} > 0 ]]; then
                              ^-- SC2071 (error): > is for string comparisons. Use -gt instead.


In gensrc/script/gen_build_version.sh line 228:
if [[ ${build_version_hotfix} > 0 ]]; then
                              ^-- SC2071 (error): > is for string comparisons. Use -gt instead.

For more information:
  https://www.shellcheck.net/wiki/SC2071 -- > is for string comparisons. Use ...
----------

You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
  # shellcheck disable=NNNN
above the line that contains the issue, where NNNN is the error code;
3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.
shfmt errors 
'shfmt ' found no issues.

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39645 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 523670d19348be27637194f12e512d71b11d20ed, data reload: false

------ Round 1 ----------------------------------
q1	17603	7429	7230	7230
q2	2042	177	164	164
q3	10629	1119	1133	1119
q4	10572	742	737	737
q5	7605	2687	2642	2642
q6	239	151	149	149
q7	989	630	593	593
q8	9242	1854	1889	1854
q9	6577	6361	6395	6361
q10	7272	2341	2328	2328
q11	479	266	270	266
q12	441	232	230	230
q13	17911	2939	2969	2939
q14	247	210	222	210
q15	554	503	506	503
q16	661	595	584	584
q17	964	499	511	499
q18	7207	6710	6661	6661
q19	1350	967	974	967
q20	479	184	184	184
q21	4080	3343	3114	3114
q22	373	313	311	311
Total cold run time: 107516 ms
Total hot run time: 39645 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7242	7202	7185	7185
q2	326	225	234	225
q3	2888	2789	2938	2789
q4	2047	1815	1836	1815
q5	5672	5645	5673	5645
q6	224	143	146	143
q7	2247	1816	1848	1816
q8	3398	3561	3501	3501
q9	8836	8923	8913	8913
q10	3589	3521	3516	3516
q11	607	517	506	506
q12	837	625	594	594
q13	11904	3167	3074	3074
q14	308	268	280	268
q15	569	514	503	503
q16	711	662	650	650
q17	1870	1620	1616	1616
q18	8284	7722	7811	7722
q19	2168	1532	1491	1491
q20	2066	1859	1877	1859
q21	5659	5476	5414	5414
q22	627	584	561	561
Total cold run time: 72079 ms
Total hot run time: 59806 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196646 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 523670d19348be27637194f12e512d71b11d20ed, data reload: false

query1	1290	932	958	932
query2	6289	2294	2344	2294
query3	10982	4757	4641	4641
query4	33261	23515	23444	23444
query5	4245	474	493	474
query6	293	190	187	187
query7	4009	311	316	311
query8	308	248	245	245
query9	9611	2691	2702	2691
query10	459	244	249	244
query11	18021	15322	15140	15140
query12	152	108	102	102
query13	1568	420	404	404
query14	9893	7053	7813	7053
query15	261	209	218	209
query16	8327	448	416	416
query17	1637	630	601	601
query18	2235	325	334	325
query19	384	181	182	181
query20	129	117	117	117
query21	211	113	117	113
query22	4612	4648	4497	4497
query23	35031	33943	33844	33844
query24	10503	2499	2645	2499
query25	658	471	409	409
query26	1037	163	157	157
query27	2683	334	346	334
query28	7688	2454	2465	2454
query29	823	415	420	415
query30	234	158	154	154
query31	1052	865	864	864
query32	105	56	59	56
query33	766	301	306	301
query34	980	542	552	542
query35	896	772	803	772
query36	1149	974	977	974
query37	140	82	91	82
query38	4255	4272	4041	4041
query39	1531	1478	1440	1440
query40	210	104	112	104
query41	43	45	45	45
query42	112	106	101	101
query43	539	495	476	476
query44	1367	842	826	826
query45	194	169	180	169
query46	1213	739	749	739
query47	2017	1955	1904	1904
query48	414	333	331	331
query49	1066	389	382	382
query50	829	413	420	413
query51	7416	7233	7284	7233
query52	105	95	96	95
query53	267	189	189	189
query54	1272	429	425	425
query55	91	83	83	83
query56	294	244	243	243
query57	1282	1163	1137	1137
query58	239	242	220	220
query59	3363	3279	3114	3114
query60	281	245	246	245
query61	111	106	108	106
query62	870	702	697	697
query63	236	194	197	194
query64	3985	712	663	663
query65	3308	3297	3256	3256
query66	777	309	353	309
query67	16417	15544	15553	15544
query68	6044	543	537	537
query69	500	254	253	253
query70	1178	1101	1145	1101
query71	525	259	259	259
query72	6651	4168	4055	4055
query73	817	366	376	366
query74	10125	8819	8761	8761
query75	4212	2651	2647	2647
query76	4476	1141	1022	1022
query77	670	278	285	278
query78	10203	9518	9345	9345
query79	1130	620	594	594
query80	749	450	430	430
query81	512	228	223	223
query82	276	118	115	115
query83	171	146	141	141
query84	288	79	75	75
query85	1073	307	310	307
query86	361	297	299	297
query87	4474	4562	4348	4348
query88	4014	2228	2193	2193
query89	431	294	303	294
query90	2120	191	191	191
query91	143	104	104	104
query92	62	54	53	53
query93	2929	546	536	536
query94	884	288	273	273
query95	345	264	254	254
query96	625	277	346	277
query97	2866	2610	2714	2610
query98	220	193	197	193
query99	1536	1312	1344	1312
Total cold run time: 306636 ms
Total hot run time: 196646 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.45 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 523670d19348be27637194f12e512d71b11d20ed, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.62	0.11	0.11
query5	0.42	0.43	0.41
query6	1.19	0.64	0.64
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.59	0.49	0.50
query10	0.55	0.56	0.56
query11	0.14	0.10	0.10
query12	0.15	0.12	0.11
query13	0.61	0.60	0.60
query14	2.87	2.73	2.72
query15	0.91	0.82	0.83
query16	0.37	0.40	0.39
query17	1.06	1.04	1.07
query18	0.23	0.21	0.21
query19	1.83	1.84	2.00
query20	0.02	0.01	0.01
query21	15.35	0.60	0.58
query22	2.98	2.33	1.73
query23	16.81	1.16	0.84
query24	3.27	1.14	0.75
query25	0.22	0.11	0.13
query26	0.49	0.14	0.14
query27	0.05	0.04	0.03
query28	10.70	1.12	1.07
query29	12.60	3.21	3.23
query30	0.26	0.06	0.06
query31	2.85	0.39	0.38
query32	3.24	0.46	0.45
query33	3.04	3.19	3.21
query34	17.26	4.46	4.45
query35	4.47	4.46	4.49
query36	0.68	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.03	0.03
query39	0.04	0.02	0.03
query40	0.17	0.13	0.12
query41	0.07	0.03	0.02
query42	0.03	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 107.71 s
Total hot run time: 32.45 s

@englefly
Copy link
Contributor Author

run buildall

@englefly englefly changed the title [feat](regression) when check shape failed, print all plan with memo [feat](nereids) when check shape failed, print all plan with memo Dec 19, 2024
@github-actions GitHub Actions
Copy link
Contributor

sh-checker report

To get the full details, please check in the job output.

shellcheck errors 

'shellcheck ' returned error 1 finding the following syntactical issues:

----------

In gensrc/script/gen_build_version.sh line 38:
if [[ ${build_version_hotfix} > 0 ]]; then
                              ^-- SC2071 (error): > is for string comparisons. Use -gt instead.


In gensrc/script/gen_build_version.sh line 228:
if [[ ${build_version_hotfix} > 0 ]]; then
                              ^-- SC2071 (error): > is for string comparisons. Use -gt instead.

For more information:
  https://www.shellcheck.net/wiki/SC2071 -- > is for string comparisons. Use ...
----------

You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
  # shellcheck disable=NNNN
above the line that contains the issue, where NNNN is the error code;
3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.
shfmt errors 
'shfmt ' found no issues.

@doris-robot
Copy link

TPC-H: Total hot run time: 39821 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4dc24cddb00bfc0146974133e473528d337e9091, data reload: false

------ Round 1 ----------------------------------
q1	17586	7420	7241	7241
q2	2048	181	169	169
q3	10555	1159	1194	1159
q4	10240	673	668	668
q5	7592	2688	2726	2688
q6	241	149	146	146
q7	995	630	620	620
q8	9237	1854	1927	1854
q9	6575	6471	6438	6438
q10	6979	2292	2310	2292
q11	461	260	262	260
q12	422	232	223	223
q13	17786	2878	2893	2878
q14	254	219	216	216
q15	563	510	505	505
q16	673	587	602	587
q17	991	554	525	525
q18	7429	6700	6621	6621
q19	1347	961	1043	961
q20	470	183	183	183
q21	4648	3346	3271	3271
q22	380	316	328	316
Total cold run time: 107472 ms
Total hot run time: 39821 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7219	7249	7223	7223
q2	329	230	231	230
q3	2932	2769	3092	2769
q4	2136	1888	1839	1839
q5	5564	5737	5630	5630
q6	222	142	140	140
q7	2254	1759	1751	1751
q8	3353	3502	3451	3451
q9	8857	8932	8985	8932
q10	3585	3582	3527	3527
q11	586	517	506	506
q12	801	608	605	605
q13	12043	3108	3026	3026
q14	297	269	264	264
q15	555	504	503	503
q16	714	642	632	632
q17	1870	1593	1545	1545
q18	7811	7454	7429	7429
q19	1690	1385	1500	1385
q20	2053	1790	1788	1788
q21	5432	5279	5166	5166
q22	655	600	568	568
Total cold run time: 70958 ms
Total hot run time: 58909 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191595 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4dc24cddb00bfc0146974133e473528d337e9091, data reload: false

query1	975	383	386	383
query2	6516	2385	2267	2267
query3	6716	219	215	215
query4	33910	23417	23456	23417
query5	4362	494	458	458
query6	275	195	200	195
query7	4633	313	301	301
query8	307	251	230	230
query9	9650	2720	2713	2713
query10	479	255	253	253
query11	17959	15210	15261	15210
query12	158	104	112	104
query13	1664	439	407	407
query14	10700	7097	7779	7097
query15	294	182	182	182
query16	8299	407	381	381
query17	1757	628	556	556
query18	2050	288	295	288
query19	379	161	148	148
query20	128	110	114	110
query21	210	103	101	101
query22	4557	4321	4311	4311
query23	34496	35325	34697	34697
query24	11329	2464	2454	2454
query25	533	379	390	379
query26	1161	152	153	152
query27	2678	336	335	335
query28	7720	2410	2422	2410
query29	651	399	403	399
query30	312	150	148	148
query31	1009	813	819	813
query32	102	60	61	60
query33	770	303	290	290
query34	938	522	527	522
query35	860	746	744	744
query36	1082	957	944	944
query37	121	73	78	73
query38	4179	4305	4221	4221
query39	1504	1448	1415	1415
query40	282	106	107	106
query41	51	45	48	45
query42	113	106	105	105
query43	535	495	484	484
query44	1243	837	808	808
query45	183	177	172	172
query46	1175	725	715	715
query47	1953	1843	1842	1842
query48	429	318	309	309
query49	1265	407	404	404
query50	813	388	400	388
query51	7077	7130	7000	7000
query52	104	92	93	92
query53	261	179	185	179
query54	1061	412	413	412
query55	78	77	90	77
query56	268	257	236	236
query57	1275	1107	1117	1107
query58	238	224	253	224
query59	3131	2929	2977	2929
query60	285	257	262	257
query61	110	106	103	103
query62	897	671	680	671
query63	217	191	191	191
query64	5040	649	643	643
query65	3240	3222	3212	3212
query66	1229	320	335	320
query67	15547	15464	15562	15464
query68	5628	565	558	558
query69	433	263	261	261
query70	1211	1164	1148	1148
query71	355	259	258	258
query72	6170	4125	4029	4029
query73	789	356	356	356
query74	10401	8912	8845	8845
query75	3410	2641	2700	2641
query76	3603	1105	1053	1053
query77	521	283	301	283
query78	10160	9422	9352	9352
query79	1434	603	606	603
query80	856	442	437	437
query81	540	234	237	234
query82	715	123	125	123
query83	267	144	149	144
query84	238	122	70	70
query85	1659	306	314	306
query86	480	303	307	303
query87	4650	4321	4494	4321
query88	4138	2212	2192	2192
query89	404	296	295	295
query90	2109	191	188	188
query91	142	103	110	103
query92	68	53	54	53
query93	1923	549	542	542
query94	1029	284	298	284
query95	373	253	250	250
query96	621	276	281	276
query97	2871	2717	2698	2698
query98	219	194	197	194
query99	1550	1317	1317	1317
Total cold run time: 302490 ms
Total hot run time: 191595 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.38 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4dc24cddb00bfc0146974133e473528d337e9091, data reload: false

query1	0.04	0.04	0.03
query2	0.06	0.03	0.04
query3	0.22	0.07	0.07
query4	1.61	0.10	0.10
query5	0.44	0.40	0.43
query6	1.19	0.65	0.65
query7	0.02	0.02	0.01
query8	0.03	0.03	0.03
query9	0.56	0.53	0.49
query10	0.55	0.59	0.55
query11	0.14	0.12	0.11
query12	0.14	0.11	0.12
query13	0.62	0.60	0.61
query14	2.89	2.77	2.87
query15	0.90	0.83	0.82
query16	0.37	0.37	0.40
query17	1.05	1.06	1.04
query18	0.22	0.21	0.21
query19	1.92	1.86	1.98
query20	0.01	0.01	0.01
query21	15.36	0.59	0.60
query22	2.39	2.92	2.10
query23	17.04	0.96	0.89
query24	2.95	1.64	1.19
query25	0.29	0.34	0.11
query26	0.41	0.14	0.13
query27	0.05	0.04	0.05
query28	9.99	1.11	1.07
query29	12.60	3.25	3.25
query30	0.25	0.07	0.07
query31	2.85	0.38	0.38
query32	3.25	0.46	0.46
query33	3.17	3.08	3.16
query34	17.20	4.54	4.50
query35	4.44	4.46	4.48
query36	0.67	0.48	0.49
query37	0.10	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.16	0.12	0.12
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.38 s
Total hot run time: 33.38 s

@englefly
Copy link
Contributor Author

run p0

@englefly
Copy link
Contributor Author

run cloud_p0

@englefly
Copy link
Contributor Author

run external

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39946 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4dc24cddb00bfc0146974133e473528d337e9091, data reload: false

------ Round 1 ----------------------------------
q1	17594	8339	7301	7301
q2	2055	189	181	181
q3	10553	1074	1171	1074
q4	10529	728	748	728
q5	7643	2705	2696	2696
q6	241	147	144	144
q7	979	617	605	605
q8	9252	1890	1930	1890
q9	6639	6412	6444	6412
q10	7056	2332	2318	2318
q11	461	268	261	261
q12	422	220	219	219
q13	17951	2878	3104	2878
q14	249	217	218	217
q15	557	535	510	510
q16	666	589	603	589
q17	992	553	611	553
q18	7359	6733	6656	6656
q19	1355	1080	939	939
q20	471	184	186	184
q21	4021	3312	3279	3279
q22	380	312	313	312
Total cold run time: 107425 ms
Total hot run time: 39946 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7283	7224	7281	7224
q2	332	234	229	229
q3	2938	2914	2979	2914
q4	2105	1852	1832	1832
q5	5632	5640	5685	5640
q6	230	139	141	139
q7	2294	1829	1862	1829
q8	3383	3536	3548	3536
q9	8973	9019	8993	8993
q10	3625	3540	3581	3540
q11	597	523	507	507
q12	811	591	628	591
q13	13786	3100	3096	3096
q14	312	273	284	273
q15	554	504	505	504
q16	699	651	652	651
q17	1875	1666	1657	1657
q18	8346	7731	7573	7573
q19	1755	1592	1675	1592
q20	2112	1828	1871	1828
q21	5653	5473	5432	5432
q22	671	611	572	572
Total cold run time: 73966 ms
Total hot run time: 60152 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196517 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4dc24cddb00bfc0146974133e473528d337e9091, data reload: false

query1	1294	979	941	941
query2	6254	2269	2325	2269
query3	11082	4840	4512	4512
query4	33328	23377	23348	23348
query5	3610	465	443	443
query6	288	189	182	182
query7	4009	308	296	296
query8	286	228	222	222
query9	9536	2675	2654	2654
query10	468	251	257	251
query11	17695	15076	15162	15076
query12	165	104	105	104
query13	1581	428	443	428
query14	9877	7088	7531	7088
query15	258	210	199	199
query16	7717	460	485	460
query17	1692	623	612	612
query18	2059	351	332	332
query19	387	166	205	166
query20	125	111	114	111
query21	222	107	105	105
query22	4697	4727	4764	4727
query23	35120	34000	33730	33730
query24	10550	2453	2446	2446
query25	642	390	395	390
query26	1180	161	156	156
query27	2399	331	343	331
query28	7435	2445	2425	2425
query29	808	405	413	405
query30	240	153	149	149
query31	1084	842	844	842
query32	106	55	56	55
query33	781	324	289	289
query34	974	532	516	516
query35	927	766	777	766
query36	1101	946	979	946
query37	139	72	75	72
query38	4259	4268	4548	4268
query39	1497	1455	1465	1455
query40	198	103	102	102
query41	46	44	45	44
query42	115	104	109	104
query43	528	490	494	490
query44	1277	833	840	833
query45	189	173	169	169
query46	1194	725	718	718
query47	2030	1950	1953	1950
query48	437	322	325	322
query49	896	398	374	374
query50	830	394	391	391
query51	7379	7158	7231	7158
query52	104	92	94	92
query53	261	183	183	183
query54	1267	411	411	411
query55	82	81	80	80
query56	267	250	226	226
query57	1317	1187	1183	1183
query58	227	235	226	226
query59	3487	3143	3069	3069
query60	294	278	255	255
query61	110	108	111	108
query62	914	695	695	695
query63	220	192	188	188
query64	4167	695	644	644
query65	3215	3187	3188	3187
query66	807	293	295	293
query67	16069	15523	15517	15517
query68	4920	541	568	541
query69	498	257	243	243
query70	1146	1139	1060	1060
query71	480	249	245	245
query72	7061	4171	4095	4095
query73	793	364	359	359
query74	10063	8878	8886	8878
query75	3612	2672	2662	2662
query76	3825	1122	1073	1073
query77	577	262	283	262
query78	10275	9433	9468	9433
query79	1908	597	602	597
query80	705	427	421	421
query81	500	235	248	235
query82	720	121	119	119
query83	171	144	140	140
query84	243	74	72	72
query85	1518	308	300	300
query86	471	310	258	258
query87	4597	4304	4437	4304
query88	3715	2227	2224	2224
query89	443	286	301	286
query90	2019	184	185	184
query91	153	108	107	107
query92	69	51	52	51
query93	2244	547	543	543
query94	855	296	301	296
query95	355	246	252	246
query96	620	288	284	284
query97	2856	2700	2700	2700
query98	230	203	201	201
query99	1566	1320	1319	1319
Total cold run time: 303007 ms
Total hot run time: 196517 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.28 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4dc24cddb00bfc0146974133e473528d337e9091, data reload: false

query1	0.03	0.03	0.03
query2	0.09	0.03	0.03
query3	0.24	0.07	0.08
query4	1.60	0.11	0.11
query5	0.42	0.40	0.42
query6	1.15	0.66	0.65
query7	0.02	0.01	0.02
query8	0.05	0.04	0.03
query9	0.59	0.50	0.51
query10	0.55	0.57	0.54
query11	0.15	0.10	0.11
query12	0.14	0.11	0.10
query13	0.61	0.61	0.59
query14	2.79	2.71	2.71
query15	0.91	0.83	0.83
query16	0.37	0.37	0.39
query17	1.07	1.02	1.05
query18	0.22	0.22	0.20
query19	1.97	1.83	1.98
query20	0.01	0.01	0.02
query21	15.37	0.57	0.56
query22	2.42	2.62	1.92
query23	16.91	0.93	0.87
query24	3.09	0.54	1.38
query25	0.29	0.04	0.24
query26	0.41	0.14	0.14
query27	0.05	0.05	0.04
query28	10.61	1.11	1.07
query29	12.61	3.21	3.20
query30	0.25	0.07	0.06
query31	2.86	0.40	0.38
query32	3.24	0.46	0.46
query33	3.18	3.10	3.10
query34	17.00	4.50	4.53
query35	4.55	4.52	4.53
query36	0.68	0.47	0.47
query37	0.10	0.06	0.05
query38	0.05	0.04	0.03
query39	0.04	0.02	0.03
query40	0.17	0.15	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.02	0.03
Total cold run time: 107 s
Total hot run time: 32.28 s

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39845 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e540843eb1c7fd0972244733518791c560371e15, data reload: false

------ Round 1 ----------------------------------
q1	17600	7579	7325	7325
q2	2045	173	165	165
q3	10635	1091	1159	1091
q4	10573	767	740	740
q5	7585	2611	2701	2611
q6	240	147	153	147
q7	992	647	606	606
q8	9259	1849	1933	1849
q9	6569	6362	6312	6312
q10	6991	2302	2285	2285
q11	462	258	252	252
q12	435	226	227	226
q13	17783	2980	2945	2945
q14	252	223	218	218
q15	566	507	504	504
q16	665	583	593	583
q17	971	518	574	518
q18	7344	6830	6774	6774
q19	1341	988	968	968
q20	472	187	182	182
q21	4051	3444	3237	3237
q22	381	317	307	307
Total cold run time: 107212 ms
Total hot run time: 39845 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7330	7392	7311	7311
q2	335	230	236	230
q3	2897	2859	3007	2859
q4	2072	1832	1875	1832
q5	5734	5649	5634	5634
q6	224	145	144	144
q7	2237	1814	1803	1803
q8	3397	3554	3492	3492
q9	8971	9021	8905	8905
q10	3899	3547	3571	3547
q11	601	496	506	496
q12	801	611	587	587
q13	12227	3188	3119	3119
q14	308	266	281	266
q15	569	510	510	510
q16	703	642	639	639
q17	1836	1656	1593	1593
q18	8349	7751	7644	7644
q19	1703	1392	1520	1392
q20	2075	1944	1876	1876
q21	5758	5480	5404	5404
q22	645	584	560	560
Total cold run time: 72671 ms
Total hot run time: 59843 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196125 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e540843eb1c7fd0972244733518791c560371e15, data reload: false

query1	1314	1021	899	899
query2	6233	2469	2257	2257
query3	11057	4900	4801	4801
query4	33091	23414	23347	23347
query5	4359	470	443	443
query6	286	188	198	188
query7	3982	306	319	306
query8	301	238	249	238
query9	9606	2680	2677	2677
query10	470	249	248	248
query11	18001	15299	15129	15129
query12	149	103	99	99
query13	1585	418	414	414
query14	9798	7207	6787	6787
query15	273	212	202	202
query16	8150	468	436	436
query17	1616	613	627	613
query18	2174	322	326	322
query19	392	174	172	172
query20	126	114	117	114
query21	213	108	114	108
query22	4719	4724	4448	4448
query23	38046	33848	33732	33732
query24	10217	2508	2526	2508
query25	539	430	412	412
query26	844	162	156	156
query27	2725	345	351	345
query28	7935	2456	2419	2419
query29	672	409	417	409
query30	232	151	149	149
query31	1043	814	849	814
query32	96	54	61	54
query33	745	325	298	298
query34	1119	540	535	535
query35	905	769	741	741
query36	1105	957	946	946
query37	125	76	74	74
query38	4362	4157	4166	4157
query39	1493	1515	1489	1489
query40	259	104	98	98
query41	46	42	43	42
query42	112	101	103	101
query43	560	500	494	494
query44	1379	868	857	857
query45	189	172	177	172
query46	1190	725	732	725
query47	2090	1878	1958	1878
query48	416	329	330	329
query49	871	402	400	400
query50	828	399	400	399
query51	7269	7031	7306	7031
query52	104	91	91	91
query53	270	182	184	182
query54	1010	420	446	420
query55	83	82	80	80
query56	266	251	244	244
query57	1268	1194	1176	1176
query58	231	218	230	218
query59	3264	3183	3121	3121
query60	286	255	262	255
query61	112	106	110	106
query62	841	666	690	666
query63	220	201	199	199
query64	4094	698	667	667
query65	3317	3255	3253	3253
query66	772	301	302	301
query67	16820	15701	15511	15511
query68	6378	551	559	551
query69	481	252	248	248
query70	1219	1115	1145	1115
query71	491	255	251	251
query72	6821	4105	4181	4105
query73	812	361	378	361
query74	10294	8844	8794	8794
query75	3799	2642	2661	2642
query76	4099	1114	1161	1114
query77	655	280	272	272
query78	10249	9316	9336	9316
query79	1524	615	656	615
query80	1038	434	426	426
query81	516	227	224	224
query82	210	125	122	122
query83	188	147	145	145
query84	285	70	72	70
query85	1035	303	321	303
query86	350	297	296	296
query87	4499	4401	4312	4312
query88	4733	2204	2187	2187
query89	426	294	301	294
query90	2260	189	191	189
query91	156	107	106	106
query92	67	52	51	51
query93	4217	548	544	544
query94	1067	295	299	295
query95	350	259	251	251
query96	656	275	284	275
query97	2931	2679	2682	2679
query98	233	194	196	194
query99	1613	1276	1320	1276
Total cold run time: 311917 ms
Total hot run time: 196125 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.01 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e540843eb1c7fd0972244733518791c560371e15, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.04	0.03
query3	0.23	0.07	0.07
query4	1.59	0.10	0.10
query5	0.41	0.41	0.43
query6	1.14	0.64	0.65
query7	0.02	0.01	0.02
query8	0.04	0.03	0.04
query9	0.58	0.50	0.52
query10	0.57	0.58	0.57
query11	0.14	0.11	0.11
query12	0.14	0.12	0.11
query13	0.60	0.60	0.60
query14	2.74	2.75	2.72
query15	0.88	0.82	0.83
query16	0.39	0.38	0.39
query17	1.05	1.01	0.98
query18	0.23	0.21	0.21
query19	1.85	1.90	1.95
query20	0.01	0.01	0.02
query21	15.36	0.59	0.60
query22	2.85	2.27	2.05
query23	16.89	0.98	0.86
query24	3.42	0.94	1.38
query25	0.18	0.15	0.22
query26	0.38	0.14	0.13
query27	0.04	0.04	0.04
query28	10.06	1.10	1.07
query29	12.63	3.19	3.21
query30	0.25	0.06	0.06
query31	2.85	0.39	0.39
query32	3.24	0.47	0.46
query33	3.09	3.06	3.11
query34	17.06	4.49	4.56
query35	4.51	4.49	4.54
query36	0.67	0.48	0.53
query37	0.09	0.06	0.06
query38	0.04	0.04	0.04
query39	0.04	0.03	0.02
query40	0.17	0.14	0.13
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 106.68 s
Total hot run time: 33.01 s

@englefly
Copy link
Contributor Author

run buildall

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39813 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7a82825a220bccab8aab3f14e71f61ecddec3a64, data reload: false

------ Round 1 ----------------------------------
q1	17606	7399	7265	7265
q2	2052	194	168	168
q3	10585	1118	1201	1118
q4	10217	732	688	688
q5	7610	2692	2723	2692
q6	236	149	146	146
q7	990	621	605	605
q8	9234	1819	1888	1819
q9	6613	6397	6405	6397
q10	7008	2292	2275	2275
q11	462	286	256	256
q12	421	225	227	225
q13	17806	2912	2945	2912
q14	253	213	212	212
q15	569	511	497	497
q16	654	575	587	575
q17	984	527	491	491
q18	7251	6764	6977	6764
q19	1430	1029	998	998
q20	476	192	184	184
q21	4136	3206	3232	3206
q22	386	330	320	320
Total cold run time: 106979 ms
Total hot run time: 39813 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7298	7216	7363	7216
q2	332	227	233	227
q3	2882	2751	2936	2751
q4	2074	1807	1762	1762
q5	5668	5691	5668	5668
q6	219	144	140	140
q7	2239	1819	1847	1819
q8	3367	3542	3519	3519
q9	8894	9105	8974	8974
q10	3569	3536	3575	3536
q11	603	519	522	519
q12	858	627	618	618
q13	11008	3163	3092	3092
q14	320	287	278	278
q15	569	515	509	509
q16	696	657	647	647
q17	1871	1622	1621	1621
q18	8259	7880	7620	7620
q19	1738	1628	1510	1510
q20	2158	1849	1870	1849
q21	5618	5437	5387	5387
q22	648	585	595	585
Total cold run time: 70888 ms
Total hot run time: 59847 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197245 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7a82825a220bccab8aab3f14e71f61ecddec3a64, data reload: false

query1	1282	940	954	940
query2	6266	2405	2317	2317
query3	11008	4562	4740	4562
query4	32810	23303	23718	23303
query5	4036	468	452	452
query6	278	184	196	184
query7	3990	315	310	310
query8	311	245	247	245
query9	9486	2723	2723	2723
query10	492	246	262	246
query11	18059	15043	15384	15043
query12	157	107	100	100
query13	1571	436	400	400
query14	9192	7450	7148	7148
query15	247	198	198	198
query16	7969	448	458	448
query17	1552	595	588	588
query18	2140	297	316	297
query19	239	160	165	160
query20	117	116	114	114
query21	213	103	105	103
query22	5010	4552	4485	4485
query23	35015	34183	34123	34123
query24	10779	2588	2541	2541
query25	595	399	410	399
query26	1040	158	162	158
query27	2273	348	342	342
query28	7201	2463	2436	2436
query29	786	428	434	428
query30	226	154	146	146
query31	1043	849	872	849
query32	96	59	56	56
query33	765	332	332	332
query34	1046	547	539	539
query35	908	793	795	793
query36	1135	954	983	954
query37	147	78	80	78
query38	4495	4390	4243	4243
query39	1524	1485	1432	1432
query40	213	113	112	112
query41	48	54	46	46
query42	115	106	111	106
query43	560	500	506	500
query44	1353	829	854	829
query45	196	174	180	174
query46	1248	770	788	770
query47	2049	1915	1901	1901
query48	437	343	322	322
query49	1037	408	411	408
query50	820	428	402	402
query51	7385	7260	7083	7083
query52	111	94	99	94
query53	276	184	186	184
query54	1328	435	411	411
query55	90	81	79	79
query56	275	275	245	245
query57	1272	1201	1164	1164
query58	231	221	230	221
query59	3336	3135	3026	3026
query60	291	248	248	248
query61	110	108	101	101
query62	864	700	690	690
query63	230	204	216	204
query64	3822	718	661	661
query65	3294	3276	3298	3276
query66	766	302	307	302
query67	16390	15728	15520	15520
query68	6016	546	552	546
query69	503	260	259	259
query70	1218	1148	1139	1139
query71	499	254	259	254
query72	6602	4060	4186	4060
query73	805	360	361	360
query74	10196	8928	8810	8810
query75	4188	2678	2682	2678
query76	4270	1053	1120	1053
query77	681	287	298	287
query78	10311	9585	9490	9490
query79	2007	624	629	624
query80	1323	438	436	436
query81	502	238	225	225
query82	741	123	120	120
query83	187	150	156	150
query84	285	73	68	68
query85	1440	305	298	298
query86	415	301	296	296
query87	4684	4432	4638	4432
query88	3772	2223	2205	2205
query89	429	292	297	292
query90	2007	194	190	190
query91	139	105	103	103
query92	67	52	52	52
query93	3446	552	550	550
query94	805	279	282	279
query95	356	263	251	251
query96	646	297	282	282
query97	2904	2695	2666	2666
query98	218	215	193	193
query99	1615	1347	1303	1303
Total cold run time: 306923 ms
Total hot run time: 197245 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.54 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7a82825a220bccab8aab3f14e71f61ecddec3a64, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.03
query3	0.24	0.07	0.08
query4	1.60	0.11	0.11
query5	0.42	0.45	0.42
query6	1.18	0.66	0.66
query7	0.02	0.01	0.01
query8	0.04	0.03	0.04
query9	0.57	0.50	0.49
query10	0.56	0.57	0.56
query11	0.14	0.10	0.11
query12	0.14	0.11	0.10
query13	0.62	0.59	0.60
query14	2.71	2.82	2.89
query15	0.90	0.83	0.83
query16	0.39	0.38	0.39
query17	0.98	0.99	1.04
query18	0.22	0.21	0.21
query19	1.90	1.86	2.04
query20	0.01	0.00	0.01
query21	15.38	0.59	0.58
query22	2.43	2.75	1.53
query23	16.94	1.04	0.82
query24	2.70	1.45	0.93
query25	0.19	0.30	0.18
query26	0.27	0.14	0.14
query27	0.04	0.04	0.05
query28	10.59	1.10	1.08
query29	12.60	3.21	3.22
query30	0.25	0.06	0.08
query31	2.84	0.39	0.40
query32	3.23	0.45	0.45
query33	3.10	3.22	3.15
query34	16.92	4.45	4.46
query35	4.48	4.49	4.47
query36	0.66	0.47	0.49
query37	0.09	0.05	0.06
query38	0.05	0.03	0.03
query39	0.03	0.03	0.02
query40	0.17	0.13	0.13
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.04
Total cold run time: 105.87 s
Total hot run time: 32.54 s

@doris-robot
Copy link

TPC-H: Total hot run time: 39752 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4eff7ae42b03f5f8c154a88b598d6d3911781b81, data reload: false

------ Round 1 ----------------------------------
q1	17610	7413	7243	7243
q2	2045	184	166	166
q3	10645	1068	1176	1068
q4	10553	697	640	640
q5	7608	2706	2657	2657
q6	237	149	144	144
q7	976	606	609	606
q8	9249	1896	1851	1851
q9	6566	6413	6427	6413
q10	7021	2299	2318	2299
q11	474	273	260	260
q12	460	223	226	223
q13	17805	3086	3052	3052
q14	266	219	211	211
q15	571	530	510	510
q16	685	587	595	587
q17	997	583	590	583
q18	7334	6717	6732	6717
q19	1358	1119	968	968
q20	479	187	184	184
q21	4454	3206	3069	3069
q22	372	301	319	301
Total cold run time: 107765 ms
Total hot run time: 39752 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7202	7210	7219	7210
q2	325	233	241	233
q3	2893	2761	2970	2761
q4	2061	1891	1877	1877
q5	5676	5678	5608	5608
q6	227	147	142	142
q7	2296	1865	1822	1822
q8	3369	3509	3463	3463
q9	8844	9044	9013	9013
q10	3601	3533	3573	3533
q11	596	501	519	501
q12	822	605	576	576
q13	12364	3139	3053	3053
q14	313	290	272	272
q15	566	508	529	508
q16	690	654	659	654
q17	1856	1641	1605	1605
q18	8241	7801	7686	7686
q19	1710	1537	1395	1395
q20	2055	1937	1855	1855
q21	5544	5492	5458	5458
q22	633	576	564	564
Total cold run time: 71884 ms
Total hot run time: 59789 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197720 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4eff7ae42b03f5f8c154a88b598d6d3911781b81, data reload: false

query1	1319	1005	935	935
query2	6240	2402	2402	2402
query3	11107	4675	4865	4675
query4	33382	23845	23657	23657
query5	4090	458	456	456
query6	279	176	173	173
query7	3982	313	310	310
query8	311	247	238	238
query9	9637	2773	2769	2769
query10	470	259	254	254
query11	18149	15097	15451	15097
query12	165	106	106	106
query13	1586	426	414	414
query14	9081	6772	7655	6772
query15	267	191	189	189
query16	8536	465	501	465
query17	1681	591	588	588
query18	2194	341	331	331
query19	396	162	170	162
query20	117	125	115	115
query21	207	111	112	111
query22	4789	4588	4630	4588
query23	35053	34132	33855	33855
query24	10345	2563	2474	2474
query25	602	389	401	389
query26	720	163	167	163
query27	2191	341	354	341
query28	6692	2516	2476	2476
query29	757	417	416	416
query30	240	156	156	156
query31	1074	844	836	836
query32	103	56	55	55
query33	656	298	289	289
query34	1001	531	550	531
query35	905	778	750	750
query36	1146	950	979	950
query37	124	82	81	81
query38	4374	4245	4205	4205
query39	1581	1481	1477	1477
query40	207	102	98	98
query41	44	43	43	43
query42	112	105	105	105
query43	549	503	499	499
query44	1216	844	856	844
query45	205	169	180	169
query46	1199	718	731	718
query47	2091	1914	1964	1914
query48	415	340	326	326
query49	907	406	388	388
query50	832	413	407	407
query51	7519	7163	7124	7124
query52	99	89	90	89
query53	264	186	190	186
query54	1056	419	418	418
query55	88	80	76	76
query56	263	249	252	249
query57	1314	1219	1159	1159
query58	241	223	284	223
query59	3289	3158	3257	3158
query60	291	255	268	255
query61	104	102	104	102
query62	898	695	709	695
query63	221	187	191	187
query64	3785	698	683	683
query65	3397	3308	3340	3308
query66	788	299	327	299
query67	16637	15923	15624	15624
query68	5873	556	543	543
query69	508	263	265	263
query70	1129	1138	1139	1138
query71	474	265	254	254
query72	6613	4106	4239	4106
query73	798	374	364	364
query74	10054	8870	9153	8870
query75	3815	2662	2659	2659
query76	3591	1078	1086	1078
query77	580	274	276	274
query78	10822	9897	9665	9665
query79	1166	611	601	601
query80	761	438	458	438
query81	538	246	253	246
query82	289	116	120	116
query83	173	146	141	141
query84	284	71	76	71
query85	1075	302	305	302
query86	358	296	295	295
query87	4581	4303	4569	4303
query88	4072	2251	2216	2216
query89	493	293	287	287
query90	2162	190	187	187
query91	138	104	144	104
query92	62	50	49	49
query93	4287	564	568	564
query94	977	286	295	286
query95	356	252	247	247
query96	667	285	282	282
query97	2924	2723	2669	2669
query98	212	197	201	197
query99	1551	1308	1319	1308
Total cold run time: 304963 ms
Total hot run time: 197720 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.95 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4eff7ae42b03f5f8c154a88b598d6d3911781b81, data reload: false

query1	0.03	0.05	0.03
query2	0.06	0.04	0.03
query3	0.23	0.07	0.07
query4	1.60	0.10	0.10
query5	0.42	0.42	0.41
query6	1.14	0.66	0.64
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.57	0.49	0.50
query10	0.55	0.58	0.56
query11	0.14	0.11	0.10
query12	0.13	0.11	0.11
query13	0.61	0.61	0.58
query14	2.83	2.74	2.73
query15	0.92	0.83	0.81
query16	0.39	0.37	0.38
query17	1.05	0.99	1.07
query18	0.21	0.20	0.21
query19	2.00	1.86	2.02
query20	0.01	0.01	0.01
query21	15.36	0.60	0.61
query22	2.41	2.35	2.63
query23	16.94	0.97	0.78
query24	2.58	0.73	1.35
query25	0.37	0.14	0.14
query26	0.32	0.13	0.14
query27	0.04	0.04	0.04
query28	10.86	1.11	1.07
query29	12.55	3.23	3.24
query30	0.25	0.07	0.07
query31	2.85	0.38	0.39
query32	3.27	0.47	0.46
query33	3.09	3.05	3.14
query34	17.07	4.50	4.49
query35	4.54	4.51	4.54
query36	0.68	0.48	0.48
query37	0.10	0.06	0.06
query38	0.04	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.12	0.12
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.62 s
Total hot run time: 32.95 s

@englefly
Copy link
Contributor Author

run p0

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39761 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4eff7ae42b03f5f8c154a88b598d6d3911781b81, data reload: false

------ Round 1 ----------------------------------
q1	17609	7382	7258	7258
q2	2051	185	182	182
q3	10523	1145	1179	1145
q4	10221	731	907	731
q5	7597	2715	2672	2672
q6	236	153	155	153
q7	1002	625	605	605
q8	9228	1784	1922	1784
q9	6658	6475	6391	6391
q10	7001	2303	2317	2303
q11	455	273	275	273
q12	419	223	226	223
q13	17772	2885	2947	2885
q14	250	207	208	207
q15	562	497	504	497
q16	670	572	608	572
q17	975	538	509	509
q18	7397	6746	6812	6746
q19	1346	977	898	898
q20	494	182	187	182
q21	4012	3411	3232	3232
q22	381	313	321	313
Total cold run time: 106859 ms
Total hot run time: 39761 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7211	7202	7203	7202
q2	329	237	232	232
q3	2927	2778	2977	2778
q4	2100	1850	1779	1779
q5	5604	5652	5589	5589
q6	236	146	147	146
q7	2174	1764	1770	1764
q8	3340	3492	3484	3484
q9	8864	8898	8913	8898
q10	3647	3532	3508	3508
q11	634	516	500	500
q12	790	624	569	569
q13	12960	3046	3078	3046
q14	306	268	283	268
q15	572	522	512	512
q16	693	651	649	649
q17	1881	1627	1544	1544
q18	7856	7366	7424	7366
q19	1684	1471	1458	1458
q20	2043	1816	1797	1797
q21	5274	5143	5181	5143
q22	641	598	617	598
Total cold run time: 71766 ms
Total hot run time: 58830 ms

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40070 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5c379dab69c602c64d14b6cda70bf0fd3765f3f2, data reload: false

------ Round 1 ----------------------------------
q1	17593	7357	7280	7280
q2	2051	184	197	184
q3	10532	1168	1196	1168
q4	10239	777	753	753
q5	7588	2717	2668	2668
q6	243	148	148	148
q7	984	633	621	621
q8	9257	1919	1906	1906
q9	7867	6392	6430	6392
q10	7024	2287	2331	2287
q11	480	264	279	264
q12	486	221	218	218
q13	17796	2969	2923	2923
q14	248	219	215	215
q15	571	496	517	496
q16	677	604	613	604
q17	980	585	541	541
q18	7389	6723	6879	6723
q19	1344	1022	980	980
q20	486	185	181	181
q21	3967	3208	3244	3208
q22	377	310	310	310
Total cold run time: 108179 ms
Total hot run time: 40070 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7245	7230	7233	7230
q2	327	227	233	227
q3	2896	2793	2755	2755
q4	1941	1748	1696	1696
q5	5386	5379	5414	5379
q6	220	142	139	139
q7	2122	1703	1716	1703
q8	3227	3400	3378	3378
q9	8520	8593	8574	8574
q10	3498	3408	3389	3389
q11	585	516	498	498
q12	766	565	586	565
q13	8325	2974	2975	2974
q14	299	268	261	261
q15	563	503	490	490
q16	675	627	640	627
q17	1828	1572	1585	1572
q18	7891	7497	7374	7374
q19	1713	1565	1562	1562
q20	2053	1845	1863	1845
q21	5385	5242	5301	5242
q22	623	595	599	595
Total cold run time: 66088 ms
Total hot run time: 58075 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189529 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5c379dab69c602c64d14b6cda70bf0fd3765f3f2, data reload: false

query1	977	395	380	380
query2	6507	2379	2363	2363
query3	6597	213	209	209
query4	33640	23278	23449	23278
query5	4374	469	452	452
query6	282	178	185	178
query7	4373	308	311	308
query8	305	224	217	217
query9	9175	2749	2750	2749
query10	455	253	245	245
query11	17910	15251	15126	15126
query12	158	110	114	110
query13	1459	413	405	405
query14	9725	6846	6641	6641
query15	236	187	186	186
query16	7190	389	426	389
query17	1356	558	558	558
query18	1830	295	291	291
query19	330	152	148	148
query20	114	113	117	113
query21	212	106	105	105
query22	4542	4354	4175	4175
query23	34650	33662	33684	33662
query24	10649	2458	2412	2412
query25	643	409	379	379
query26	1694	147	147	147
query27	2857	327	328	327
query28	7848	2480	2449	2449
query29	899	407	403	403
query30	294	154	147	147
query31	1042	818	790	790
query32	100	55	58	55
query33	733	301	288	288
query34	942	505	515	505
query35	907	731	752	731
query36	1134	934	964	934
query37	207	73	74	73
query38	4275	4010	4166	4010
query39	1469	1437	1424	1424
query40	275	104	103	103
query41	47	45	43	43
query42	123	103	99	99
query43	556	493	503	493
query44	1237	819	809	809
query45	185	166	166	166
query46	1171	699	699	699
query47	1955	1837	1836	1836
query48	407	334	313	313
query49	1281	385	390	385
query50	796	389	375	375
query51	7226	7038	6949	6949
query52	103	92	86	86
query53	255	188	187	187
query54	899	396	407	396
query55	79	84	84	84
query56	258	224	229	224
query57	1234	1110	1083	1083
query58	241	219	221	219
query59	3157	2980	3156	2980
query60	278	299	243	243
query61	130	108	106	106
query62	896	665	665	665
query63	223	188	193	188
query64	4968	671	636	636
query65	3297	3170	3219	3170
query66	1381	303	308	303
query67	15996	15702	15517	15517
query68	4863	578	570	570
query69	443	262	271	262
query70	1231	1142	1185	1142
query71	378	261	252	252
query72	6516	4252	4230	4230
query73	786	374	366	366
query74	10362	8887	8757	8757
query75	3441	2678	2635	2635
query76	3034	1063	1077	1063
query77	549	268	269	268
query78	10306	9716	9305	9305
query79	1904	613	614	613
query80	1058	426	439	426
query81	532	245	228	228
query82	727	114	120	114
query83	249	147	154	147
query84	249	67	167	67
query85	1364	300	308	300
query86	442	299	301	299
query87	4472	4545	4326	4326
query88	3675	2251	2214	2214
query89	406	288	327	288
query90	2173	192	187	187
query91	136	106	106	106
query92	70	55	57	55
query93	1352	561	556	556
query94	1084	284	293	284
query95	369	248	252	248
query96	622	274	275	274
query97	2855	2720	2688	2688
query98	227	197	195	195
query99	1556	1345	1347	1345
Total cold run time: 298175 ms
Total hot run time: 189529 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.3 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5c379dab69c602c64d14b6cda70bf0fd3765f3f2, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.04
query3	0.24	0.07	0.07
query4	1.60	0.11	0.11
query5	0.43	0.39	0.41
query6	1.17	0.65	0.64
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.57	0.50	0.50
query10	0.56	0.58	0.55
query11	0.15	0.10	0.10
query12	0.15	0.11	0.11
query13	0.60	0.60	0.59
query14	2.81	2.85	2.72
query15	0.89	0.84	0.83
query16	0.40	0.37	0.38
query17	1.02	1.03	1.06
query18	0.23	0.22	0.21
query19	1.83	1.78	1.93
query20	0.01	0.01	0.01
query21	15.39	0.59	0.58
query22	2.66	2.70	1.88
query23	16.99	0.98	0.79
query24	3.26	1.90	1.67
query25	0.22	0.18	0.11
query26	0.65	0.14	0.14
query27	0.04	0.04	0.04
query28	9.26	1.12	1.06
query29	12.57	3.22	3.23
query30	0.25	0.06	0.06
query31	2.85	0.39	0.40
query32	3.22	0.46	0.46
query33	3.14	3.09	3.12
query34	17.08	4.49	4.47
query35	4.50	4.43	4.53
query36	0.68	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.12	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 106.09 s
Total hot run time: 33.3 s

@englefly
Copy link
Contributor Author

run buildall

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39431 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ff01aac29147b279bcce1d3e79e04a7c5860fda3, data reload: false

------ Round 1 ----------------------------------
q1	17619	7433	7290	7290
q2	2079	189	161	161
q3	10712	1079	1237	1079
q4	10554	806	732	732
q5	7605	2689	2722	2689
q6	235	148	148	148
q7	991	622	600	600
q8	9414	1897	1921	1897
q9	6629	6335	6434	6335
q10	6987	2286	2287	2286
q11	471	257	256	256
q12	414	219	219	219
q13	17768	2875	2934	2875
q14	243	211	217	211
q15	545	510	490	490
q16	664	574	595	574
q17	977	559	515	515
q18	7145	6698	6462	6462
q19	1358	976	926	926
q20	481	183	183	183
q21	4151	3191	3198	3191
q22	379	315	312	312
Total cold run time: 107421 ms
Total hot run time: 39431 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7230	7195	7210	7195
q2	337	229	237	229
q3	2866	2764	2900	2764
q4	2054	1817	1780	1780
q5	5664	5627	5608	5608
q6	224	141	143	141
q7	2201	1778	1823	1778
q8	3336	3543	3521	3521
q9	9002	8992	9020	8992
q10	3583	3586	3521	3521
q11	595	521	512	512
q12	827	606	602	602
q13	13110	3087	3082	3082
q14	315	273	271	271
q15	554	488	516	488
q16	688	617	663	617
q17	1860	1619	1594	1594
q18	8277	7841	7743	7743
q19	1747	1547	1631	1547
q20	2052	1833	1932	1833
q21	5600	5417	5387	5387
q22	643	595	607	595
Total cold run time: 72765 ms
Total hot run time: 59800 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195928 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ff01aac29147b279bcce1d3e79e04a7c5860fda3, data reload: false

query1	1302	958	891	891
query2	6737	2327	2326	2326
query3	10947	4607	4492	4492
query4	33041	23407	23363	23363
query5	4142	459	440	440
query6	280	187	192	187
query7	3996	315	322	315
query8	309	250	242	242
query9	9530	2783	2765	2765
query10	473	258	255	255
query11	17874	15028	15107	15028
query12	157	103	103	103
query13	1585	422	426	422
query14	9638	6753	7315	6753
query15	287	226	191	191
query16	8292	480	456	456
query17	1700	613	613	613
query18	2174	304	307	304
query19	372	158	171	158
query20	131	112	117	112
query21	206	109	112	109
query22	4646	4527	4592	4527
query23	34362	33605	33813	33605
query24	10022	2604	2531	2531
query25	598	391	417	391
query26	715	165	166	165
query27	2107	340	348	340
query28	6453	2518	2488	2488
query29	754	420	412	412
query30	231	156	157	156
query31	1054	819	864	819
query32	88	57	54	54
query33	691	303	295	295
query34	975	527	528	527
query35	916	768	778	768
query36	1136	955	967	955
query37	122	82	74	74
query38	4187	4081	4340	4081
query39	1491	1464	1422	1422
query40	219	111	100	100
query41	46	49	43	43
query42	117	112	108	108
query43	570	530	515	515
query44	1216	849	849	849
query45	199	175	167	167
query46	1209	710	715	710
query47	2041	1900	1926	1900
query48	432	336	331	331
query49	867	401	396	396
query50	844	390	384	384
query51	7282	7043	7158	7043
query52	103	92	93	92
query53	264	183	191	183
query54	1100	419	429	419
query55	106	78	78	78
query56	269	246	264	246
query57	1270	1181	1150	1150
query58	233	227	239	227
query59	3297	3227	3243	3227
query60	286	241	282	241
query61	115	106	104	104
query62	870	683	712	683
query63	231	197	203	197
query64	3926	682	707	682
query65	3294	3267	3222	3222
query66	877	330	324	324
query67	16513	15580	15330	15330
query68	5738	632	570	570
query69	499	256	257	256
query70	1212	1143	1149	1143
query71	497	255	246	246
query72	6628	4045	4114	4045
query73	779	378	370	370
query74	10177	8824	8845	8824
query75	3766	2631	2624	2624
query76	3830	1041	1054	1041
query77	553	288	300	288
query78	11043	9637	9978	9637
query79	2359	626	625	625
query80	951	440	434	434
query81	509	246	240	240
query82	559	120	119	119
query83	193	142	146	142
query84	288	80	66	66
query85	832	319	297	297
query86	413	311	284	284
query87	4437	4383	4309	4309
query88	4021	2235	2205	2205
query89	449	288	296	288
query90	2126	188	189	188
query91	134	106	105	105
query92	66	54	49	49
query93	3348	559	550	550
query94	851	265	258	258
query95	350	262	247	247
query96	631	289	283	283
query97	2850	2644	2625	2625
query98	217	193	193	193
query99	1643	1309	1291	1291
Total cold run time: 303466 ms
Total hot run time: 195928 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.69 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ff01aac29147b279bcce1d3e79e04a7c5860fda3, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.03
query3	0.24	0.08	0.07
query4	1.60	0.10	0.10
query5	0.41	0.41	0.42
query6	1.14	0.65	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.58	0.50	0.53
query10	0.55	0.58	0.56
query11	0.14	0.10	0.10
query12	0.13	0.10	0.11
query13	0.60	0.62	0.59
query14	2.85	2.74	2.75
query15	0.90	0.81	0.82
query16	0.38	0.37	0.38
query17	1.06	1.04	1.04
query18	0.24	0.21	0.21
query19	1.88	1.75	1.95
query20	0.01	0.01	0.01
query21	15.36	0.57	0.57
query22	2.76	2.81	1.74
query23	16.99	1.00	0.82
query24	3.21	0.35	1.33
query25	0.29	0.18	0.05
query26	0.38	0.14	0.14
query27	0.04	0.05	0.04
query28	10.83	1.10	1.07
query29	12.57	3.27	3.21
query30	0.25	0.06	0.06
query31	2.86	0.39	0.37
query32	3.24	0.46	0.45
query33	3.02	3.10	3.16
query34	16.71	4.41	4.45
query35	4.48	4.41	4.41
query36	0.69	0.47	0.49
query37	0.10	0.06	0.06
query38	0.04	0.03	0.04
query39	0.03	0.03	0.02
query40	0.17	0.13	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.03
query43	0.03	0.03	0.03
Total cold run time: 107.05 s
Total hot run time: 31.69 s

@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Dec 24, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@englefly englefly merged commit 9b0d962 into apache:master Dec 24, 2024
24 of 25 checks passed
@englefly englefly deleted the rt-all-plan branch December 24, 2024 03:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@LiBinfeng-01 LiBinfeng-01 LiBinfeng-01 approved these changes

@starocean999 starocean999 starocean999 approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@englefly @hello-stephen @doris-robot @starocean999 @LiBinfeng-01