Skip to content

Change yaml bench output format #8451

Change yaml bench output format

Change yaml bench output format #8451

Triggered via pull request January 15, 2025 09:59
Status Failure
Total duration 19m 4s
Artifacts

ci.yaml

on: pull_request
Matrix: run-avx-tests
format
12s
format
clippy
20s
clippy
run-wasm32-wasip1-tests
56s
run-wasm32-wasip1-tests
run-neon-tests
32s
run-neon-tests
run-tests
32s
run-tests
run-slow-tests
1m 2s
run-slow-tests
run-tests-parallel
35s
run-tests-parallel
machete
23s
machete
doc
43s
doc
run-wasm32-unknown-tests
41s
run-wasm32-unknown-tests
run-avx512-bench
17m 39s
run-avx512-bench
run-avx512-bench-parallel
17m 12s
run-avx512-bench-parallel
all-tests
1s
all-tests
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 10 warnings
run-avx512-bench-parallel
No benchmark result was found in /home/runner/_work/stwo/stwo/output.txt. Benchmark output was ' running 0 tests test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s simd bit_rev 26bit time: [60.332 ms 63.924 ms 68.408 ms] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high mild cpu bit_rev 24bit time: [162.76 ms 164.59 ms 167.18 ms] Found 2 outliers among 10 measurements (20.00%) 1 (10.00%) low mild 1 (10.00%) high severe simd eval_at_secure_field_point 2^20 time: [886.80 µs 890.53 µs 896.44 µs] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high severe cpu eval_at_secure_field_point 2^20 time: [24.046 ms 24.258 ms 24.669 ms] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high mild iffts/simd ifft/16 time: [112.31 µs 113.06 µs 114.08 µs] thrpt: [2.1402 GiB/s 2.1594 GiB/s 2.1737 GiB/s] Found 2 outliers among 10 measurements (20.00%) 2 (20.00%) high severe iffts/simd ifft/17 time: [203.73 µs 209.43 µs 214.69 µs] thrpt: [2.2743 GiB/s 2.3315 GiB/s 2.3967 GiB/s] iffts/simd ifft/18 time: [395.49 µs 407.20 µs 425.38 µs] thrpt: [2.2957 GiB/s 2.3983 GiB/s 2.4692 GiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high severe iffts/simd ifft/19 time: [759.73 µs 779.35 µs 802.75 µs] thrpt: [2.4330 GiB/s 2.5061 GiB/s 2.5708 GiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high severe iffts/simd ifft/20 time: [1.5097 ms 1.5276 ms 1.5606 ms] thrpt: [2.5031 GiB/s 2.5571 GiB/s 2.5875 GiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high mild iffts/simd ifft/21 time: [3.7053 ms 3.7493 ms 3.8048 ms] thrpt: [2.0533 GiB/s 2.0837 GiB/s 2.1085 GiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high mild iffts/simd ifft/22 time: [7.1200 ms 7.1785 ms 7.3014 ms] thrpt: [2.1400 GiB/s 2.1766 GiB/s 2.1945 GiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high mild iffts/simd ifft/23 time: [16.929 ms 17.086 ms 17.269 ms] thrpt: [1.8096 GiB/s 1.8290 GiB/s 1.8459 GiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high severe iffts/simd ifft/24 time: [33.498 ms 33.746 ms 34.203 ms] thrpt: [1.8273 GiB/s 1.8521 GiB/s 1.8658 GiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high mild iffts/simd ifft/25 time: [68.270 ms 68.585 ms 68.971 ms] thrpt: [1.8124 GiB/s 1.8226 GiB/s 1.8310 GiB/s] iffts/simd ifft/26 time: [139.97 ms 140.35 ms 140.78 ms] thrpt: [1.7758 GiB/s 1.7812 GiB/s 1.7861 GiB/s] iffts/simd ifft/27 time: [286.74 ms 289.32 ms 292.68 ms] thrpt: [1.7083 GiB/s 1.7282 GiB/s 1.7438 GiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high mild iffts/simd ifft/28 time: [589.12 ms 592.56 ms 596.07 ms] thrpt: [1.6777 GiB/s 1.6876 GiB/s 1.6974 GiB/s] ifft parts/simd ifft_vecwise_loop 2^14 time: [12.651 µs 12.723 µs 12.815 µs] thrpt: [4.7629 GiB/s 4.7973 GiB/s 4.8243 GiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high severe ifft parts/simd ifft3_loop 2^14 time: [4.4341 µs 4.4609 µs 4.5040 µs] thrpt: [13.551 GiB/s 13.682 GiB/s 13.765 GiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high mild ifft parts/simd transpose_vecs 2^20 time: [255.63 µs 267.83 µs 277.50 µs] thrpt: [14.076 GiB/s 14.585 GiB/s 15.281 GiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high mild simd rfft 20bit time: [1.5417 ms 1.5669 ms 1.5887 ms] Found 1 outliers
run-avx512-bench
No benchmark result was found in /home/runner/_work/stwo/stwo/output.txt. Benchmark output was ' running 0 tests test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s simd bit_rev 26bit time: [81.003 ms 82.730 ms 84.808 ms] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high mild cpu bit_rev 24bit time: [165.26 ms 167.01 ms 169.09 ms] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high mild simd eval_at_secure_field_point 2^20 time: [896.86 µs 919.35 µs 945.12 µs] Found 2 outliers among 10 measurements (20.00%) 1 (10.00%) high mild 1 (10.00%) high severe cpu eval_at_secure_field_point 2^20 time: [24.025 ms 24.211 ms 24.437 ms] iffts/simd ifft/16 time: [112.23 µs 117.51 µs 123.52 µs] thrpt: [1.9766 GiB/s 2.0777 GiB/s 2.1754 GiB/s] Found 2 outliers among 10 measurements (20.00%) 1 (10.00%) high mild 1 (10.00%) high severe iffts/simd ifft/17 time: [267.11 µs 268.64 µs 272.46 µs] thrpt: [1.7921 GiB/s 1.8176 GiB/s 1.8280 GiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high severe iffts/simd ifft/18 time: [562.42 µs 563.70 µs 565.14 µs] thrpt: [1.7280 GiB/s 1.7324 GiB/s 1.7364 GiB/s] Found 3 outliers among 10 measurements (30.00%) 1 (10.00%) low severe 1 (10.00%) low mild 1 (10.00%) high mild iffts/simd ifft/19 time: [1.1821 ms 1.1848 ms 1.1874 ms] thrpt: [1.6449 GiB/s 1.6485 GiB/s 1.6523 GiB/s] iffts/simd ifft/20 time: [2.5082 ms 2.5147 ms 2.5206 ms] thrpt: [1.5497 GiB/s 1.5534 GiB/s 1.5574 GiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high mild iffts/simd ifft/21 time: [6.6059 ms 6.6598 ms 6.6937 ms] thrpt: [1.1671 GiB/s 1.1731 GiB/s 1.1827 GiB/s] iffts/simd ifft/22 time: [13.419 ms 13.476 ms 13.562 ms] thrpt: [1.1521 GiB/s 1.1595 GiB/s 1.1644 GiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high mild iffts/simd ifft/23 time: [29.295 ms 29.433 ms 29.629 ms] thrpt: [1.0547 GiB/s 1.0617 GiB/s 1.0667 GiB/s] Found 2 outliers among 10 measurements (20.00%) 2 (20.00%) high mild iffts/simd ifft/24 time: [58.964 ms 59.303 ms 59.524 ms] thrpt: [1.0500 GiB/s 1.0539 GiB/s 1.0600 GiB/s] iffts/simd ifft/25 time: [126.04 ms 129.06 ms 132.13 ms] thrpt: [968.74 MiB/s 991.79 MiB/s 1015.6 MiB/s] iffts/simd ifft/26 time: [253.65 ms 255.55 ms 257.92 ms] thrpt: [992.54 MiB/s 1001.8 MiB/s 1009.2 MiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high mild iffts/simd ifft/27 time: [531.20 ms 537.03 ms 545.13 ms] thrpt: [939.22 MiB/s 953.38 MiB/s 963.86 MiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high severe iffts/simd ifft/28 time: [1.1369 s 1.1471 s 1.1577 s] thrpt: [884.51 MiB/s 892.67 MiB/s 900.68 MiB/s] ifft parts/simd ifft_vecwise_loop 2^14 time: [12.508 µs 12.571 µs 12.669 µs] thrpt: [4.8177 GiB/s 4.8552 GiB/s 4.8795 GiB/s] Found 3 outliers among 10 measurements (30.00%) 1 (10.00%) low mild 1 (10.00%) high mild 1 (10.00%) high severe ifft parts/simd ifft3_loop 2^14 time: [4.3942 µs 4.4453 µs 4.5091 µs] thrpt: [13.536 GiB/s 13.730 GiB/s 13.890 GiB/s] Found 1 outliers among 10 measurements (10.00%) 1 (10.00%) high severe ifft parts/simd transpose_vecs 2^20 time: [297.16 µs 325.08 µs 345.61 µs] thrpt: [11.303 GiB/s 12.016 GiB/s 13.145 GiB/s] Found 2 outliers among 10 measurements (20.00%) 2 (20.00%) high severe simd rfft 20bit time: [2.9575 ms 2.9863 ms 3.0501 ms] M31 mul time: [46.690 ms 46.
format
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
clippy
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
machete
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
run-tests
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
run-tests-parallel
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
run-wasm32-unknown-tests
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
doc
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
run-wasm32-wasip1-tests
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
run-slow-tests
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
all-tests
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636