Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feat](nereids) when check shape failed, print all plan with memo #45627

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

englefly
Copy link
Contributor

@englefly englefly commented Dec 19, 2024

What problem does this PR solve?

when check plan shape failed, print all plan and memo into log for debug

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

Copy link
Contributor

sh-checker report

To get the full details, please check in the job output.

shellcheck errors

'shellcheck ' returned error 1 finding the following syntactical issues:

----------

In gensrc/script/gen_build_version.sh line 38:
if [[ ${build_version_hotfix} > 0 ]]; then
                              ^-- SC2071 (error): > is for string comparisons. Use -gt instead.


In gensrc/script/gen_build_version.sh line 228:
if [[ ${build_version_hotfix} > 0 ]]; then
                              ^-- SC2071 (error): > is for string comparisons. Use -gt instead.

For more information:
  https://www.shellcheck.net/wiki/SC2071 -- > is for string comparisons. Use ...
----------

You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
  # shellcheck disable=NNNN
above the line that contains the issue, where NNNN is the error code;
3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.



shfmt errors
'shfmt ' found no issues.

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39645 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 523670d19348be27637194f12e512d71b11d20ed, data reload: false

------ Round 1 ----------------------------------
q1	17603	7429	7230	7230
q2	2042	177	164	164
q3	10629	1119	1133	1119
q4	10572	742	737	737
q5	7605	2687	2642	2642
q6	239	151	149	149
q7	989	630	593	593
q8	9242	1854	1889	1854
q9	6577	6361	6395	6361
q10	7272	2341	2328	2328
q11	479	266	270	266
q12	441	232	230	230
q13	17911	2939	2969	2939
q14	247	210	222	210
q15	554	503	506	503
q16	661	595	584	584
q17	964	499	511	499
q18	7207	6710	6661	6661
q19	1350	967	974	967
q20	479	184	184	184
q21	4080	3343	3114	3114
q22	373	313	311	311
Total cold run time: 107516 ms
Total hot run time: 39645 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7242	7202	7185	7185
q2	326	225	234	225
q3	2888	2789	2938	2789
q4	2047	1815	1836	1815
q5	5672	5645	5673	5645
q6	224	143	146	143
q7	2247	1816	1848	1816
q8	3398	3561	3501	3501
q9	8836	8923	8913	8913
q10	3589	3521	3516	3516
q11	607	517	506	506
q12	837	625	594	594
q13	11904	3167	3074	3074
q14	308	268	280	268
q15	569	514	503	503
q16	711	662	650	650
q17	1870	1620	1616	1616
q18	8284	7722	7811	7722
q19	2168	1532	1491	1491
q20	2066	1859	1877	1859
q21	5659	5476	5414	5414
q22	627	584	561	561
Total cold run time: 72079 ms
Total hot run time: 59806 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196646 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 523670d19348be27637194f12e512d71b11d20ed, data reload: false

query1	1290	932	958	932
query2	6289	2294	2344	2294
query3	10982	4757	4641	4641
query4	33261	23515	23444	23444
query5	4245	474	493	474
query6	293	190	187	187
query7	4009	311	316	311
query8	308	248	245	245
query9	9611	2691	2702	2691
query10	459	244	249	244
query11	18021	15322	15140	15140
query12	152	108	102	102
query13	1568	420	404	404
query14	9893	7053	7813	7053
query15	261	209	218	209
query16	8327	448	416	416
query17	1637	630	601	601
query18	2235	325	334	325
query19	384	181	182	181
query20	129	117	117	117
query21	211	113	117	113
query22	4612	4648	4497	4497
query23	35031	33943	33844	33844
query24	10503	2499	2645	2499
query25	658	471	409	409
query26	1037	163	157	157
query27	2683	334	346	334
query28	7688	2454	2465	2454
query29	823	415	420	415
query30	234	158	154	154
query31	1052	865	864	864
query32	105	56	59	56
query33	766	301	306	301
query34	980	542	552	542
query35	896	772	803	772
query36	1149	974	977	974
query37	140	82	91	82
query38	4255	4272	4041	4041
query39	1531	1478	1440	1440
query40	210	104	112	104
query41	43	45	45	45
query42	112	106	101	101
query43	539	495	476	476
query44	1367	842	826	826
query45	194	169	180	169
query46	1213	739	749	739
query47	2017	1955	1904	1904
query48	414	333	331	331
query49	1066	389	382	382
query50	829	413	420	413
query51	7416	7233	7284	7233
query52	105	95	96	95
query53	267	189	189	189
query54	1272	429	425	425
query55	91	83	83	83
query56	294	244	243	243
query57	1282	1163	1137	1137
query58	239	242	220	220
query59	3363	3279	3114	3114
query60	281	245	246	245
query61	111	106	108	106
query62	870	702	697	697
query63	236	194	197	194
query64	3985	712	663	663
query65	3308	3297	3256	3256
query66	777	309	353	309
query67	16417	15544	15553	15544
query68	6044	543	537	537
query69	500	254	253	253
query70	1178	1101	1145	1101
query71	525	259	259	259
query72	6651	4168	4055	4055
query73	817	366	376	366
query74	10125	8819	8761	8761
query75	4212	2651	2647	2647
query76	4476	1141	1022	1022
query77	670	278	285	278
query78	10203	9518	9345	9345
query79	1130	620	594	594
query80	749	450	430	430
query81	512	228	223	223
query82	276	118	115	115
query83	171	146	141	141
query84	288	79	75	75
query85	1073	307	310	307
query86	361	297	299	297
query87	4474	4562	4348	4348
query88	4014	2228	2193	2193
query89	431	294	303	294
query90	2120	191	191	191
query91	143	104	104	104
query92	62	54	53	53
query93	2929	546	536	536
query94	884	288	273	273
query95	345	264	254	254
query96	625	277	346	277
query97	2866	2610	2714	2610
query98	220	193	197	193
query99	1536	1312	1344	1312
Total cold run time: 306636 ms
Total hot run time: 196646 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.45 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 523670d19348be27637194f12e512d71b11d20ed, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.62	0.11	0.11
query5	0.42	0.43	0.41
query6	1.19	0.64	0.64
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.59	0.49	0.50
query10	0.55	0.56	0.56
query11	0.14	0.10	0.10
query12	0.15	0.12	0.11
query13	0.61	0.60	0.60
query14	2.87	2.73	2.72
query15	0.91	0.82	0.83
query16	0.37	0.40	0.39
query17	1.06	1.04	1.07
query18	0.23	0.21	0.21
query19	1.83	1.84	2.00
query20	0.02	0.01	0.01
query21	15.35	0.60	0.58
query22	2.98	2.33	1.73
query23	16.81	1.16	0.84
query24	3.27	1.14	0.75
query25	0.22	0.11	0.13
query26	0.49	0.14	0.14
query27	0.05	0.04	0.03
query28	10.70	1.12	1.07
query29	12.60	3.21	3.23
query30	0.26	0.06	0.06
query31	2.85	0.39	0.38
query32	3.24	0.46	0.45
query33	3.04	3.19	3.21
query34	17.26	4.46	4.45
query35	4.47	4.46	4.49
query36	0.68	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.03	0.03
query39	0.04	0.02	0.03
query40	0.17	0.13	0.12
query41	0.07	0.03	0.02
query42	0.03	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 107.71 s
Total hot run time: 32.45 s

@englefly
Copy link
Contributor Author

run buildall

@englefly englefly changed the title [feat](regression) when check shape failed, print all plan with memo [feat](nereids) when check shape failed, print all plan with memo Dec 19, 2024
Copy link
Contributor

sh-checker report

To get the full details, please check in the job output.

shellcheck errors

'shellcheck ' returned error 1 finding the following syntactical issues:

----------

In gensrc/script/gen_build_version.sh line 38:
if [[ ${build_version_hotfix} > 0 ]]; then
                              ^-- SC2071 (error): > is for string comparisons. Use -gt instead.


In gensrc/script/gen_build_version.sh line 228:
if [[ ${build_version_hotfix} > 0 ]]; then
                              ^-- SC2071 (error): > is for string comparisons. Use -gt instead.

For more information:
  https://www.shellcheck.net/wiki/SC2071 -- > is for string comparisons. Use ...
----------

You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
  # shellcheck disable=NNNN
above the line that contains the issue, where NNNN is the error code;
3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.



shfmt errors
'shfmt ' found no issues.

@doris-robot
Copy link

TPC-H: Total hot run time: 39821 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4dc24cddb00bfc0146974133e473528d337e9091, data reload: false

------ Round 1 ----------------------------------
q1	17586	7420	7241	7241
q2	2048	181	169	169
q3	10555	1159	1194	1159
q4	10240	673	668	668
q5	7592	2688	2726	2688
q6	241	149	146	146
q7	995	630	620	620
q8	9237	1854	1927	1854
q9	6575	6471	6438	6438
q10	6979	2292	2310	2292
q11	461	260	262	260
q12	422	232	223	223
q13	17786	2878	2893	2878
q14	254	219	216	216
q15	563	510	505	505
q16	673	587	602	587
q17	991	554	525	525
q18	7429	6700	6621	6621
q19	1347	961	1043	961
q20	470	183	183	183
q21	4648	3346	3271	3271
q22	380	316	328	316
Total cold run time: 107472 ms
Total hot run time: 39821 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7219	7249	7223	7223
q2	329	230	231	230
q3	2932	2769	3092	2769
q4	2136	1888	1839	1839
q5	5564	5737	5630	5630
q6	222	142	140	140
q7	2254	1759	1751	1751
q8	3353	3502	3451	3451
q9	8857	8932	8985	8932
q10	3585	3582	3527	3527
q11	586	517	506	506
q12	801	608	605	605
q13	12043	3108	3026	3026
q14	297	269	264	264
q15	555	504	503	503
q16	714	642	632	632
q17	1870	1593	1545	1545
q18	7811	7454	7429	7429
q19	1690	1385	1500	1385
q20	2053	1790	1788	1788
q21	5432	5279	5166	5166
q22	655	600	568	568
Total cold run time: 70958 ms
Total hot run time: 58909 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191595 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4dc24cddb00bfc0146974133e473528d337e9091, data reload: false

query1	975	383	386	383
query2	6516	2385	2267	2267
query3	6716	219	215	215
query4	33910	23417	23456	23417
query5	4362	494	458	458
query6	275	195	200	195
query7	4633	313	301	301
query8	307	251	230	230
query9	9650	2720	2713	2713
query10	479	255	253	253
query11	17959	15210	15261	15210
query12	158	104	112	104
query13	1664	439	407	407
query14	10700	7097	7779	7097
query15	294	182	182	182
query16	8299	407	381	381
query17	1757	628	556	556
query18	2050	288	295	288
query19	379	161	148	148
query20	128	110	114	110
query21	210	103	101	101
query22	4557	4321	4311	4311
query23	34496	35325	34697	34697
query24	11329	2464	2454	2454
query25	533	379	390	379
query26	1161	152	153	152
query27	2678	336	335	335
query28	7720	2410	2422	2410
query29	651	399	403	399
query30	312	150	148	148
query31	1009	813	819	813
query32	102	60	61	60
query33	770	303	290	290
query34	938	522	527	522
query35	860	746	744	744
query36	1082	957	944	944
query37	121	73	78	73
query38	4179	4305	4221	4221
query39	1504	1448	1415	1415
query40	282	106	107	106
query41	51	45	48	45
query42	113	106	105	105
query43	535	495	484	484
query44	1243	837	808	808
query45	183	177	172	172
query46	1175	725	715	715
query47	1953	1843	1842	1842
query48	429	318	309	309
query49	1265	407	404	404
query50	813	388	400	388
query51	7077	7130	7000	7000
query52	104	92	93	92
query53	261	179	185	179
query54	1061	412	413	412
query55	78	77	90	77
query56	268	257	236	236
query57	1275	1107	1117	1107
query58	238	224	253	224
query59	3131	2929	2977	2929
query60	285	257	262	257
query61	110	106	103	103
query62	897	671	680	671
query63	217	191	191	191
query64	5040	649	643	643
query65	3240	3222	3212	3212
query66	1229	320	335	320
query67	15547	15464	15562	15464
query68	5628	565	558	558
query69	433	263	261	261
query70	1211	1164	1148	1148
query71	355	259	258	258
query72	6170	4125	4029	4029
query73	789	356	356	356
query74	10401	8912	8845	8845
query75	3410	2641	2700	2641
query76	3603	1105	1053	1053
query77	521	283	301	283
query78	10160	9422	9352	9352
query79	1434	603	606	603
query80	856	442	437	437
query81	540	234	237	234
query82	715	123	125	123
query83	267	144	149	144
query84	238	122	70	70
query85	1659	306	314	306
query86	480	303	307	303
query87	4650	4321	4494	4321
query88	4138	2212	2192	2192
query89	404	296	295	295
query90	2109	191	188	188
query91	142	103	110	103
query92	68	53	54	53
query93	1923	549	542	542
query94	1029	284	298	284
query95	373	253	250	250
query96	621	276	281	276
query97	2871	2717	2698	2698
query98	219	194	197	194
query99	1550	1317	1317	1317
Total cold run time: 302490 ms
Total hot run time: 191595 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.38 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4dc24cddb00bfc0146974133e473528d337e9091, data reload: false

query1	0.04	0.04	0.03
query2	0.06	0.03	0.04
query3	0.22	0.07	0.07
query4	1.61	0.10	0.10
query5	0.44	0.40	0.43
query6	1.19	0.65	0.65
query7	0.02	0.02	0.01
query8	0.03	0.03	0.03
query9	0.56	0.53	0.49
query10	0.55	0.59	0.55
query11	0.14	0.12	0.11
query12	0.14	0.11	0.12
query13	0.62	0.60	0.61
query14	2.89	2.77	2.87
query15	0.90	0.83	0.82
query16	0.37	0.37	0.40
query17	1.05	1.06	1.04
query18	0.22	0.21	0.21
query19	1.92	1.86	1.98
query20	0.01	0.01	0.01
query21	15.36	0.59	0.60
query22	2.39	2.92	2.10
query23	17.04	0.96	0.89
query24	2.95	1.64	1.19
query25	0.29	0.34	0.11
query26	0.41	0.14	0.13
query27	0.05	0.04	0.05
query28	9.99	1.11	1.07
query29	12.60	3.25	3.25
query30	0.25	0.07	0.07
query31	2.85	0.38	0.38
query32	3.25	0.46	0.46
query33	3.17	3.08	3.16
query34	17.20	4.54	4.50
query35	4.44	4.46	4.48
query36	0.67	0.48	0.49
query37	0.10	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.16	0.12	0.12
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.38 s
Total hot run time: 33.38 s

@englefly
Copy link
Contributor Author

run p0

@englefly
Copy link
Contributor Author

run cloud_p0

@englefly
Copy link
Contributor Author

run external

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39946 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4dc24cddb00bfc0146974133e473528d337e9091, data reload: false

------ Round 1 ----------------------------------
q1	17594	8339	7301	7301
q2	2055	189	181	181
q3	10553	1074	1171	1074
q4	10529	728	748	728
q5	7643	2705	2696	2696
q6	241	147	144	144
q7	979	617	605	605
q8	9252	1890	1930	1890
q9	6639	6412	6444	6412
q10	7056	2332	2318	2318
q11	461	268	261	261
q12	422	220	219	219
q13	17951	2878	3104	2878
q14	249	217	218	217
q15	557	535	510	510
q16	666	589	603	589
q17	992	553	611	553
q18	7359	6733	6656	6656
q19	1355	1080	939	939
q20	471	184	186	184
q21	4021	3312	3279	3279
q22	380	312	313	312
Total cold run time: 107425 ms
Total hot run time: 39946 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7283	7224	7281	7224
q2	332	234	229	229
q3	2938	2914	2979	2914
q4	2105	1852	1832	1832
q5	5632	5640	5685	5640
q6	230	139	141	139
q7	2294	1829	1862	1829
q8	3383	3536	3548	3536
q9	8973	9019	8993	8993
q10	3625	3540	3581	3540
q11	597	523	507	507
q12	811	591	628	591
q13	13786	3100	3096	3096
q14	312	273	284	273
q15	554	504	505	504
q16	699	651	652	651
q17	1875	1666	1657	1657
q18	8346	7731	7573	7573
q19	1755	1592	1675	1592
q20	2112	1828	1871	1828
q21	5653	5473	5432	5432
q22	671	611	572	572
Total cold run time: 73966 ms
Total hot run time: 60152 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196517 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4dc24cddb00bfc0146974133e473528d337e9091, data reload: false

query1	1294	979	941	941
query2	6254	2269	2325	2269
query3	11082	4840	4512	4512
query4	33328	23377	23348	23348
query5	3610	465	443	443
query6	288	189	182	182
query7	4009	308	296	296
query8	286	228	222	222
query9	9536	2675	2654	2654
query10	468	251	257	251
query11	17695	15076	15162	15076
query12	165	104	105	104
query13	1581	428	443	428
query14	9877	7088	7531	7088
query15	258	210	199	199
query16	7717	460	485	460
query17	1692	623	612	612
query18	2059	351	332	332
query19	387	166	205	166
query20	125	111	114	111
query21	222	107	105	105
query22	4697	4727	4764	4727
query23	35120	34000	33730	33730
query24	10550	2453	2446	2446
query25	642	390	395	390
query26	1180	161	156	156
query27	2399	331	343	331
query28	7435	2445	2425	2425
query29	808	405	413	405
query30	240	153	149	149
query31	1084	842	844	842
query32	106	55	56	55
query33	781	324	289	289
query34	974	532	516	516
query35	927	766	777	766
query36	1101	946	979	946
query37	139	72	75	72
query38	4259	4268	4548	4268
query39	1497	1455	1465	1455
query40	198	103	102	102
query41	46	44	45	44
query42	115	104	109	104
query43	528	490	494	490
query44	1277	833	840	833
query45	189	173	169	169
query46	1194	725	718	718
query47	2030	1950	1953	1950
query48	437	322	325	322
query49	896	398	374	374
query50	830	394	391	391
query51	7379	7158	7231	7158
query52	104	92	94	92
query53	261	183	183	183
query54	1267	411	411	411
query55	82	81	80	80
query56	267	250	226	226
query57	1317	1187	1183	1183
query58	227	235	226	226
query59	3487	3143	3069	3069
query60	294	278	255	255
query61	110	108	111	108
query62	914	695	695	695
query63	220	192	188	188
query64	4167	695	644	644
query65	3215	3187	3188	3187
query66	807	293	295	293
query67	16069	15523	15517	15517
query68	4920	541	568	541
query69	498	257	243	243
query70	1146	1139	1060	1060
query71	480	249	245	245
query72	7061	4171	4095	4095
query73	793	364	359	359
query74	10063	8878	8886	8878
query75	3612	2672	2662	2662
query76	3825	1122	1073	1073
query77	577	262	283	262
query78	10275	9433	9468	9433
query79	1908	597	602	597
query80	705	427	421	421
query81	500	235	248	235
query82	720	121	119	119
query83	171	144	140	140
query84	243	74	72	72
query85	1518	308	300	300
query86	471	310	258	258
query87	4597	4304	4437	4304
query88	3715	2227	2224	2224
query89	443	286	301	286
query90	2019	184	185	184
query91	153	108	107	107
query92	69	51	52	51
query93	2244	547	543	543
query94	855	296	301	296
query95	355	246	252	246
query96	620	288	284	284
query97	2856	2700	2700	2700
query98	230	203	201	201
query99	1566	1320	1319	1319
Total cold run time: 303007 ms
Total hot run time: 196517 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.28 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4dc24cddb00bfc0146974133e473528d337e9091, data reload: false

query1	0.03	0.03	0.03
query2	0.09	0.03	0.03
query3	0.24	0.07	0.08
query4	1.60	0.11	0.11
query5	0.42	0.40	0.42
query6	1.15	0.66	0.65
query7	0.02	0.01	0.02
query8	0.05	0.04	0.03
query9	0.59	0.50	0.51
query10	0.55	0.57	0.54
query11	0.15	0.10	0.11
query12	0.14	0.11	0.10
query13	0.61	0.61	0.59
query14	2.79	2.71	2.71
query15	0.91	0.83	0.83
query16	0.37	0.37	0.39
query17	1.07	1.02	1.05
query18	0.22	0.22	0.20
query19	1.97	1.83	1.98
query20	0.01	0.01	0.02
query21	15.37	0.57	0.56
query22	2.42	2.62	1.92
query23	16.91	0.93	0.87
query24	3.09	0.54	1.38
query25	0.29	0.04	0.24
query26	0.41	0.14	0.14
query27	0.05	0.05	0.04
query28	10.61	1.11	1.07
query29	12.61	3.21	3.20
query30	0.25	0.07	0.06
query31	2.86	0.40	0.38
query32	3.24	0.46	0.46
query33	3.18	3.10	3.10
query34	17.00	4.50	4.53
query35	4.55	4.52	4.53
query36	0.68	0.47	0.47
query37	0.10	0.06	0.05
query38	0.05	0.04	0.03
query39	0.04	0.02	0.03
query40	0.17	0.15	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.02	0.03
Total cold run time: 107 s
Total hot run time: 32.28 s

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39845 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e540843eb1c7fd0972244733518791c560371e15, data reload: false

------ Round 1 ----------------------------------
q1	17600	7579	7325	7325
q2	2045	173	165	165
q3	10635	1091	1159	1091
q4	10573	767	740	740
q5	7585	2611	2701	2611
q6	240	147	153	147
q7	992	647	606	606
q8	9259	1849	1933	1849
q9	6569	6362	6312	6312
q10	6991	2302	2285	2285
q11	462	258	252	252
q12	435	226	227	226
q13	17783	2980	2945	2945
q14	252	223	218	218
q15	566	507	504	504
q16	665	583	593	583
q17	971	518	574	518
q18	7344	6830	6774	6774
q19	1341	988	968	968
q20	472	187	182	182
q21	4051	3444	3237	3237
q22	381	317	307	307
Total cold run time: 107212 ms
Total hot run time: 39845 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7330	7392	7311	7311
q2	335	230	236	230
q3	2897	2859	3007	2859
q4	2072	1832	1875	1832
q5	5734	5649	5634	5634
q6	224	145	144	144
q7	2237	1814	1803	1803
q8	3397	3554	3492	3492
q9	8971	9021	8905	8905
q10	3899	3547	3571	3547
q11	601	496	506	496
q12	801	611	587	587
q13	12227	3188	3119	3119
q14	308	266	281	266
q15	569	510	510	510
q16	703	642	639	639
q17	1836	1656	1593	1593
q18	8349	7751	7644	7644
q19	1703	1392	1520	1392
q20	2075	1944	1876	1876
q21	5758	5480	5404	5404
q22	645	584	560	560
Total cold run time: 72671 ms
Total hot run time: 59843 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196125 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e540843eb1c7fd0972244733518791c560371e15, data reload: false

query1	1314	1021	899	899
query2	6233	2469	2257	2257
query3	11057	4900	4801	4801
query4	33091	23414	23347	23347
query5	4359	470	443	443
query6	286	188	198	188
query7	3982	306	319	306
query8	301	238	249	238
query9	9606	2680	2677	2677
query10	470	249	248	248
query11	18001	15299	15129	15129
query12	149	103	99	99
query13	1585	418	414	414
query14	9798	7207	6787	6787
query15	273	212	202	202
query16	8150	468	436	436
query17	1616	613	627	613
query18	2174	322	326	322
query19	392	174	172	172
query20	126	114	117	114
query21	213	108	114	108
query22	4719	4724	4448	4448
query23	38046	33848	33732	33732
query24	10217	2508	2526	2508
query25	539	430	412	412
query26	844	162	156	156
query27	2725	345	351	345
query28	7935	2456	2419	2419
query29	672	409	417	409
query30	232	151	149	149
query31	1043	814	849	814
query32	96	54	61	54
query33	745	325	298	298
query34	1119	540	535	535
query35	905	769	741	741
query36	1105	957	946	946
query37	125	76	74	74
query38	4362	4157	4166	4157
query39	1493	1515	1489	1489
query40	259	104	98	98
query41	46	42	43	42
query42	112	101	103	101
query43	560	500	494	494
query44	1379	868	857	857
query45	189	172	177	172
query46	1190	725	732	725
query47	2090	1878	1958	1878
query48	416	329	330	329
query49	871	402	400	400
query50	828	399	400	399
query51	7269	7031	7306	7031
query52	104	91	91	91
query53	270	182	184	182
query54	1010	420	446	420
query55	83	82	80	80
query56	266	251	244	244
query57	1268	1194	1176	1176
query58	231	218	230	218
query59	3264	3183	3121	3121
query60	286	255	262	255
query61	112	106	110	106
query62	841	666	690	666
query63	220	201	199	199
query64	4094	698	667	667
query65	3317	3255	3253	3253
query66	772	301	302	301
query67	16820	15701	15511	15511
query68	6378	551	559	551
query69	481	252	248	248
query70	1219	1115	1145	1115
query71	491	255	251	251
query72	6821	4105	4181	4105
query73	812	361	378	361
query74	10294	8844	8794	8794
query75	3799	2642	2661	2642
query76	4099	1114	1161	1114
query77	655	280	272	272
query78	10249	9316	9336	9316
query79	1524	615	656	615
query80	1038	434	426	426
query81	516	227	224	224
query82	210	125	122	122
query83	188	147	145	145
query84	285	70	72	70
query85	1035	303	321	303
query86	350	297	296	296
query87	4499	4401	4312	4312
query88	4733	2204	2187	2187
query89	426	294	301	294
query90	2260	189	191	189
query91	156	107	106	106
query92	67	52	51	51
query93	4217	548	544	544
query94	1067	295	299	295
query95	350	259	251	251
query96	656	275	284	275
query97	2931	2679	2682	2679
query98	233	194	196	194
query99	1613	1276	1320	1276
Total cold run time: 311917 ms
Total hot run time: 196125 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.01 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e540843eb1c7fd0972244733518791c560371e15, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.04	0.03
query3	0.23	0.07	0.07
query4	1.59	0.10	0.10
query5	0.41	0.41	0.43
query6	1.14	0.64	0.65
query7	0.02	0.01	0.02
query8	0.04	0.03	0.04
query9	0.58	0.50	0.52
query10	0.57	0.58	0.57
query11	0.14	0.11	0.11
query12	0.14	0.12	0.11
query13	0.60	0.60	0.60
query14	2.74	2.75	2.72
query15	0.88	0.82	0.83
query16	0.39	0.38	0.39
query17	1.05	1.01	0.98
query18	0.23	0.21	0.21
query19	1.85	1.90	1.95
query20	0.01	0.01	0.02
query21	15.36	0.59	0.60
query22	2.85	2.27	2.05
query23	16.89	0.98	0.86
query24	3.42	0.94	1.38
query25	0.18	0.15	0.22
query26	0.38	0.14	0.13
query27	0.04	0.04	0.04
query28	10.06	1.10	1.07
query29	12.63	3.19	3.21
query30	0.25	0.06	0.06
query31	2.85	0.39	0.39
query32	3.24	0.47	0.46
query33	3.09	3.06	3.11
query34	17.06	4.49	4.56
query35	4.51	4.49	4.54
query36	0.67	0.48	0.53
query37	0.09	0.06	0.06
query38	0.04	0.04	0.04
query39	0.04	0.03	0.02
query40	0.17	0.14	0.13
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 106.68 s
Total hot run time: 33.01 s

@englefly
Copy link
Contributor Author

run buildall

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39813 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7a82825a220bccab8aab3f14e71f61ecddec3a64, data reload: false

------ Round 1 ----------------------------------
q1	17606	7399	7265	7265
q2	2052	194	168	168
q3	10585	1118	1201	1118
q4	10217	732	688	688
q5	7610	2692	2723	2692
q6	236	149	146	146
q7	990	621	605	605
q8	9234	1819	1888	1819
q9	6613	6397	6405	6397
q10	7008	2292	2275	2275
q11	462	286	256	256
q12	421	225	227	225
q13	17806	2912	2945	2912
q14	253	213	212	212
q15	569	511	497	497
q16	654	575	587	575
q17	984	527	491	491
q18	7251	6764	6977	6764
q19	1430	1029	998	998
q20	476	192	184	184
q21	4136	3206	3232	3206
q22	386	330	320	320
Total cold run time: 106979 ms
Total hot run time: 39813 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7298	7216	7363	7216
q2	332	227	233	227
q3	2882	2751	2936	2751
q4	2074	1807	1762	1762
q5	5668	5691	5668	5668
q6	219	144	140	140
q7	2239	1819	1847	1819
q8	3367	3542	3519	3519
q9	8894	9105	8974	8974
q10	3569	3536	3575	3536
q11	603	519	522	519
q12	858	627	618	618
q13	11008	3163	3092	3092
q14	320	287	278	278
q15	569	515	509	509
q16	696	657	647	647
q17	1871	1622	1621	1621
q18	8259	7880	7620	7620
q19	1738	1628	1510	1510
q20	2158	1849	1870	1849
q21	5618	5437	5387	5387
q22	648	585	595	585
Total cold run time: 70888 ms
Total hot run time: 59847 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197245 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7a82825a220bccab8aab3f14e71f61ecddec3a64, data reload: false

query1	1282	940	954	940
query2	6266	2405	2317	2317
query3	11008	4562	4740	4562
query4	32810	23303	23718	23303
query5	4036	468	452	452
query6	278	184	196	184
query7	3990	315	310	310
query8	311	245	247	245
query9	9486	2723	2723	2723
query10	492	246	262	246
query11	18059	15043	15384	15043
query12	157	107	100	100
query13	1571	436	400	400
query14	9192	7450	7148	7148
query15	247	198	198	198
query16	7969	448	458	448
query17	1552	595	588	588
query18	2140	297	316	297
query19	239	160	165	160
query20	117	116	114	114
query21	213	103	105	103
query22	5010	4552	4485	4485
query23	35015	34183	34123	34123
query24	10779	2588	2541	2541
query25	595	399	410	399
query26	1040	158	162	158
query27	2273	348	342	342
query28	7201	2463	2436	2436
query29	786	428	434	428
query30	226	154	146	146
query31	1043	849	872	849
query32	96	59	56	56
query33	765	332	332	332
query34	1046	547	539	539
query35	908	793	795	793
query36	1135	954	983	954
query37	147	78	80	78
query38	4495	4390	4243	4243
query39	1524	1485	1432	1432
query40	213	113	112	112
query41	48	54	46	46
query42	115	106	111	106
query43	560	500	506	500
query44	1353	829	854	829
query45	196	174	180	174
query46	1248	770	788	770
query47	2049	1915	1901	1901
query48	437	343	322	322
query49	1037	408	411	408
query50	820	428	402	402
query51	7385	7260	7083	7083
query52	111	94	99	94
query53	276	184	186	184
query54	1328	435	411	411
query55	90	81	79	79
query56	275	275	245	245
query57	1272	1201	1164	1164
query58	231	221	230	221
query59	3336	3135	3026	3026
query60	291	248	248	248
query61	110	108	101	101
query62	864	700	690	690
query63	230	204	216	204
query64	3822	718	661	661
query65	3294	3276	3298	3276
query66	766	302	307	302
query67	16390	15728	15520	15520
query68	6016	546	552	546
query69	503	260	259	259
query70	1218	1148	1139	1139
query71	499	254	259	254
query72	6602	4060	4186	4060
query73	805	360	361	360
query74	10196	8928	8810	8810
query75	4188	2678	2682	2678
query76	4270	1053	1120	1053
query77	681	287	298	287
query78	10311	9585	9490	9490
query79	2007	624	629	624
query80	1323	438	436	436
query81	502	238	225	225
query82	741	123	120	120
query83	187	150	156	150
query84	285	73	68	68
query85	1440	305	298	298
query86	415	301	296	296
query87	4684	4432	4638	4432
query88	3772	2223	2205	2205
query89	429	292	297	292
query90	2007	194	190	190
query91	139	105	103	103
query92	67	52	52	52
query93	3446	552	550	550
query94	805	279	282	279
query95	356	263	251	251
query96	646	297	282	282
query97	2904	2695	2666	2666
query98	218	215	193	193
query99	1615	1347	1303	1303
Total cold run time: 306923 ms
Total hot run time: 197245 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.54 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7a82825a220bccab8aab3f14e71f61ecddec3a64, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.03
query3	0.24	0.07	0.08
query4	1.60	0.11	0.11
query5	0.42	0.45	0.42
query6	1.18	0.66	0.66
query7	0.02	0.01	0.01
query8	0.04	0.03	0.04
query9	0.57	0.50	0.49
query10	0.56	0.57	0.56
query11	0.14	0.10	0.11
query12	0.14	0.11	0.10
query13	0.62	0.59	0.60
query14	2.71	2.82	2.89
query15	0.90	0.83	0.83
query16	0.39	0.38	0.39
query17	0.98	0.99	1.04
query18	0.22	0.21	0.21
query19	1.90	1.86	2.04
query20	0.01	0.00	0.01
query21	15.38	0.59	0.58
query22	2.43	2.75	1.53
query23	16.94	1.04	0.82
query24	2.70	1.45	0.93
query25	0.19	0.30	0.18
query26	0.27	0.14	0.14
query27	0.04	0.04	0.05
query28	10.59	1.10	1.08
query29	12.60	3.21	3.22
query30	0.25	0.06	0.08
query31	2.84	0.39	0.40
query32	3.23	0.45	0.45
query33	3.10	3.22	3.15
query34	16.92	4.45	4.46
query35	4.48	4.49	4.47
query36	0.66	0.47	0.49
query37	0.09	0.05	0.06
query38	0.05	0.03	0.03
query39	0.03	0.03	0.02
query40	0.17	0.13	0.13
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.04
Total cold run time: 105.87 s
Total hot run time: 32.54 s

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39934 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 06b07e02be89fbfa01337ba7531842492f58f228, data reload: false

------ Round 1 ----------------------------------
q1	17580	7422	7329	7329
q2	2052	180	182	180
q3	10533	1132	1206	1132
q4	10220	771	672	672
q5	7599	2730	2715	2715
q6	238	152	150	150
q7	1010	623	629	623
q8	9255	1864	1924	1864
q9	6656	6589	6411	6411
q10	6936	2324	2297	2297
q11	468	269	254	254
q12	423	230	232	230
q13	17767	2934	2882	2882
q14	249	210	221	210
q15	555	503	498	498
q16	678	614	575	575
q17	976	510	557	510
q18	7442	6679	6661	6661
q19	1339	979	943	943
q20	467	179	180	179
q21	4223	3408	3303	3303
q22	379	316	324	316
Total cold run time: 107045 ms
Total hot run time: 39934 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7231	7264	7240	7240
q2	337	228	227	227
q3	2873	2786	3079	2786
q4	2099	1850	1799	1799
q5	5599	5693	5651	5651
q6	227	140	138	138
q7	2264	1788	1802	1788
q8	3355	3548	3473	3473
q9	8986	8933	8953	8933
q10	3584	3572	3534	3534
q11	591	508	502	502
q12	822	628	594	594
q13	12670	3143	3052	3052
q14	294	265	275	265
q15	558	509	500	500
q16	701	625	642	625
q17	1809	1570	1562	1562
q18	7889	7507	7444	7444
q19	1705	1585	1480	1480
q20	2102	1831	1790	1790
q21	5487	5398	5235	5235
q22	660	608	588	588
Total cold run time: 71843 ms
Total hot run time: 59206 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190793 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 06b07e02be89fbfa01337ba7531842492f58f228, data reload: false

query1	976	394	377	377
query2	6510	2528	2402	2402
query3	6709	224	218	218
query4	33871	23452	23652	23452
query5	4272	482	472	472
query6	316	186	180	180
query7	4633	306	315	306
query8	317	245	234	234
query9	9368	2698	2697	2697
query10	463	255	256	255
query11	18024	15413	15099	15099
query12	166	104	104	104
query13	1709	437	403	403
query14	11727	6996	7646	6996
query15	312	178	180	178
query16	8087	426	467	426
query17	1809	601	578	578
query18	2145	335	301	301
query19	367	152	149	149
query20	118	111	107	107
query21	203	108	131	108
query22	4591	4215	4216	4215
query23	34544	33997	33578	33578
query24	11331	2449	2518	2449
query25	664	377	411	377
query26	1782	153	156	153
query27	2859	328	323	323
query28	7973	2402	2401	2401
query29	1025	415	410	410
query30	294	148	149	148
query31	1072	832	811	811
query32	98	61	85	61
query33	777	314	303	303
query34	955	523	531	523
query35	873	745	758	745
query36	1088	950	967	950
query37	280	72	79	72
query38	4361	4186	4083	4083
query39	1504	1422	1433	1422
query40	287	101	103	101
query41	46	44	49	44
query42	117	104	103	103
query43	549	509	491	491
query44	1250	809	805	805
query45	187	172	166	166
query46	1164	717	757	717
query47	1932	1847	1859	1847
query48	425	340	331	331
query49	1281	406	391	391
query50	815	390	400	390
query51	7276	7135	7127	7127
query52	99	92	92	92
query53	266	182	191	182
query54	1352	449	418	418
query55	88	80	80	80
query56	266	251	241	241
query57	1245	1122	1111	1111
query58	244	236	221	221
query59	3374	3220	3087	3087
query60	293	287	255	255
query61	113	105	108	105
query62	920	688	680	680
query63	219	198	198	198
query64	5054	690	648	648
query65	3252	3222	3227	3222
query66	1409	316	312	312
query67	15831	15594	15500	15500
query68	5885	550	556	550
query69	436	254	259	254
query70	1185	1065	1138	1065
query71	388	248	253	248
query72	6364	4108	4106	4106
query73	786	372	367	367
query74	10293	9033	8863	8863
query75	3448	2683	2657	2657
query76	3625	1185	1122	1122
query77	524	282	296	282
query78	10495	9389	9335	9335
query79	2476	621	629	621
query80	1093	431	432	431
query81	530	228	233	228
query82	943	127	126	126
query83	264	171	147	147
query84	242	76	75	75
query85	1360	313	300	300
query86	437	294	290	290
query87	4580	4509	4384	4384
query88	3891	2214	2195	2195
query89	419	298	297	297
query90	2148	200	193	193
query91	142	105	105	105
query92	70	55	53	53
query93	1791	544	546	544
query94	1136	286	286	286
query95	367	253	260	253
query96	620	282	290	282
query97	2825	2714	2680	2680
query98	230	204	199	199
query99	1529	1324	1324	1324
Total cold run time: 308049 ms
Total hot run time: 190793 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.33 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 06b07e02be89fbfa01337ba7531842492f58f228, data reload: false

query1	0.03	0.03	0.04
query2	0.08	0.03	0.03
query3	0.24	0.07	0.07
query4	1.60	0.11	0.11
query5	0.41	0.41	0.41
query6	1.15	0.66	0.65
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.58	0.51	0.50
query10	0.54	0.58	0.55
query11	0.15	0.11	0.10
query12	0.14	0.10	0.10
query13	0.61	0.60	0.60
query14	2.71	2.74	2.72
query15	0.89	0.83	0.83
query16	0.38	0.36	0.37
query17	0.99	0.98	1.07
query18	0.23	0.21	0.22
query19	1.97	1.86	2.00
query20	0.01	0.01	0.00
query21	15.38	0.59	0.57
query22	2.52	2.38	2.03
query23	16.83	1.00	0.75
query24	3.34	0.47	2.20
query25	0.22	0.14	0.11
query26	0.55	0.14	0.14
query27	0.05	0.04	0.04
query28	9.78	1.14	1.08
query29	12.60	3.26	3.26
query30	0.25	0.06	0.07
query31	2.87	0.39	0.38
query32	3.25	0.46	0.47
query33	3.06	3.08	3.26
query34	17.19	4.47	4.57
query35	4.56	4.51	4.55
query36	0.66	0.47	0.47
query37	0.10	0.07	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.03
query40	0.17	0.13	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.38 s
Total hot run time: 32.33 s

@englefly
Copy link
Contributor Author

run buildall

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants