Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Builtins] Make unlifting lazy again #6434

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

effectfully
Copy link
Contributor

This is technically a regression performance-wise, but we may already be charging for it (depends on how budgeting calibration works), so let's see, maybe it's not detectable regardless.

@effectfully
Copy link
Contributor Author

/benchmark validation

@effectfully
Copy link
Contributor Author

/benchmark nofib

@effectfully
Copy link
Contributor Author

/benchmark lists

@effectfully
Copy link
Contributor Author

Make your bets, is this going to happen again:

image

Copy link
Contributor

github-actions bot commented Sep 2, 2024

Click here to check the status of your benchmark.

Copy link
Contributor

github-actions bot commented Sep 2, 2024

Comparing benchmark results of 'validation' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
auction_1-1 186.1 μs 181.2 μs -2.6%
auction_1-2 654.3 μs 652.6 μs -0.3%
auction_1-3 658.0 μs 645.8 μs -1.9%
auction_1-4 240.7 μs 234.6 μs -2.5%
auction_2-1 188.9 μs 181.1 μs -4.1%
auction_2-2 662.8 μs 649.8 μs -2.0%
auction_2-3 866.2 μs 851.6 μs -1.7%
auction_2-4 657.6 μs 641.8 μs -2.4%
auction_2-5 240.3 μs 233.9 μs -2.7%
crowdfunding-success-1 218.5 μs 211.9 μs -3.0%
crowdfunding-success-2 218.5 μs 212.2 μs -2.9%
crowdfunding-success-3 218.9 μs 212.1 μs -3.1%
currency-1 256.4 μs 251.0 μs -2.1%
escrow-redeem_1-1 361.7 μs 351.9 μs -2.7%
escrow-redeem_1-2 363.6 μs 352.1 μs -3.2%
escrow-redeem_2-1 423.8 μs 408.7 μs -3.6%
escrow-redeem_2-2 423.6 μs 410.5 μs -3.1%
escrow-redeem_2-3 423.9 μs 409.8 μs -3.3%
escrow-refund-1 161.2 μs 156.3 μs -3.0%
future-increase-margin-1 255.9 μs 250.3 μs -2.2%
future-increase-margin-2 557.8 μs 543.4 μs -2.6%
future-increase-margin-3 555.9 μs 545.9 μs -1.8%
future-increase-margin-4 502.1 μs 495.8 μs -1.3%
future-increase-margin-5 834.0 μs 823.0 μs -1.3%
future-pay-out-1 254.7 μs 249.8 μs -1.9%
future-pay-out-2 556.1 μs 544.8 μs -2.0%
future-pay-out-3 554.7 μs 546.8 μs -1.4%
future-pay-out-4 834.8 μs 808.8 μs -3.1%
future-settle-early-1 254.4 μs 245.1 μs -3.7%
future-settle-early-2 556.1 μs 533.3 μs -4.1%
future-settle-early-3 555.0 μs 536.1 μs -3.4%
future-settle-early-4 624.5 μs 605.8 μs -3.0%
game-sm-success_1-1 403.4 μs 381.0 μs -5.6%
game-sm-success_1-2 206.2 μs 198.9 μs -3.5%
game-sm-success_1-3 661.1 μs 630.3 μs -4.7%
game-sm-success_1-4 234.9 μs 226.8 μs -3.4%
game-sm-success_2-1 402.6 μs 382.7 μs -4.9%
game-sm-success_2-2 206.9 μs 199.7 μs -3.5%
game-sm-success_2-3 660.7 μs 631.2 μs -4.5%
game-sm-success_2-4 234.1 μs 227.8 μs -2.7%
game-sm-success_2-5 661.1 μs 631.6 μs -4.5%
game-sm-success_2-6 233.9 μs 225.7 μs -3.5%
multisig-sm-1 409.6 μs 391.5 μs -4.4%
multisig-sm-2 399.3 μs 384.7 μs -3.7%
multisig-sm-3 403.0 μs 386.4 μs -4.1%
multisig-sm-4 406.0 μs 393.0 μs -3.2%
multisig-sm-5 572.8 μs 564.3 μs -1.5%
multisig-sm-6 410.1 μs 396.9 μs -3.2%
multisig-sm-7 393.8 μs 391.2 μs -0.7%
multisig-sm-8 396.4 μs 395.0 μs -0.4%
multisig-sm-9 401.7 μs 396.3 μs -1.3%
multisig-sm-10 566.1 μs 562.3 μs -0.7%
ping-pong-1 331.1 μs 328.1 μs -0.9%
ping-pong-2 331.1 μs 328.2 μs -0.9%
ping-pong_2-1 203.4 μs 200.4 μs -1.5%
prism-1 171.5 μs 169.3 μs -1.3%
prism-2 418.4 μs 416.3 μs -0.5%
prism-3 374.1 μs 376.2 μs +0.6%
pubkey-1 146.2 μs 144.6 μs -1.1%
stablecoin_1-1 930.0 μs 918.6 μs -1.2%
stablecoin_1-2 203.4 μs 197.4 μs -2.9%
stablecoin_1-3 1.084 ms 1.056 ms -2.6%
stablecoin_1-4 214.6 μs 210.4 μs -2.0%
stablecoin_1-5 1.378 ms 1.359 ms -1.4%
stablecoin_1-6 267.1 μs 260.9 μs -2.3%
stablecoin_2-1 938.1 μs 914.9 μs -2.5%
stablecoin_2-2 203.2 μs 198.2 μs -2.5%
stablecoin_2-3 1.084 ms 1.059 ms -2.3%
stablecoin_2-4 216.1 μs 210.5 μs -2.6%
token-account-1 197.7 μs 192.8 μs -2.5%
token-account-2 345.6 μs 341.4 μs -1.2%
uniswap-1 421.1 μs 416.9 μs -1.0%
uniswap-2 226.6 μs 223.6 μs -1.3%
uniswap-3 1.779 ms 1.761 ms -1.0%
uniswap-4 343.6 μs 339.4 μs -1.2%
uniswap-5 1.175 ms 1.160 ms -1.3%
uniswap-6 331.7 μs 323.6 μs -2.4%
vesting-1 357.7 μs 352.8 μs -1.4%
TOTAL 36.26 ms 35.43 ms -2.3%

Copy link
Contributor

github-actions bot commented Sep 2, 2024

Click here to check the status of your benchmark.

@effectfully
Copy link
Contributor Author

-2.3% in total. I don't trust it, probably just a glitch, let's see the next one.

Copy link
Contributor

github-actions bot commented Sep 2, 2024

Comparing benchmark results of 'nofib' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
clausify/formula1 3.129 ms 3.060 ms -2.2%
clausify/formula2 4.228 ms 4.087 ms -3.3%
clausify/formula3 11.59 ms 11.20 ms -3.4%
clausify/formula4 26.54 ms 26.13 ms -1.5%
clausify/formula5 56.19 ms 54.99 ms -2.1%
knights/4x4 17.96 ms 17.76 ms -1.1%
knights/6x6 47.43 ms 46.41 ms -2.2%
knights/8x8 83.40 ms 81.40 ms -2.4%
primetest/05digits 10.34 ms 10.47 ms +1.3%
primetest/10digits 20.19 ms 20.40 ms +1.0%
primetest/30digits 62.42 ms 62.47 ms +0.1%
primetest/50digits 102.5 ms 102.8 ms +0.3%
queens4x4/bt 5.497 ms 5.420 ms -1.4%
queens4x4/bm 6.960 ms 6.803 ms -2.3%
queens4x4/bjbt1 6.687 ms 6.566 ms -1.8%
queens4x4/bjbt2 6.247 ms 6.132 ms -1.8%
queens4x4/fc 14.12 ms 13.75 ms -2.6%
queens5x5/bt 74.47 ms 73.39 ms -1.5%
queens5x5/bm 77.84 ms 76.02 ms -2.3%
queens5x5/bjbt1 87.05 ms 85.52 ms -1.8%
queens5x5/bjbt2 84.47 ms 83.00 ms -1.7%
queens5x5/fc 178.8 ms 174.4 ms -2.5%
TOTAL 988.1 ms 972.2 ms -1.6%

Copy link
Contributor

github-actions bot commented Sep 2, 2024

Click here to check the status of your benchmark.

@effectfully
Copy link
Contributor Author

-1.6% in total and I still don't believe it. Also note how the primetest ones are (insignificant) regressions, those are the most sensitive to changes in the builtins code.

Copy link
Contributor

github-actions bot commented Sep 2, 2024

Comparing benchmark results of 'lists' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
sort/ghcSort/50 237.8 μs 235.9 μs -0.8%
sort/ghcSort/100 555.6 μs 546.4 μs -1.7%
sort/ghcSort/150 964.5 μs 951.1 μs -1.4%
sort/ghcSort/200 1.293 ms 1.289 ms -0.3%
sort/ghcSort/250 1.673 ms 1.682 ms +0.5%
sort/ghcSort/300 2.202 ms 2.209 ms +0.3%
sort/insertionSort/50 806.6 μs 812.8 μs +0.8%
sort/insertionSort/100 3.228 ms 3.253 ms +0.8%
sort/insertionSort/150 7.243 ms 7.318 ms +1.0%
sort/insertionSort/200 12.98 ms 13.08 ms +0.8%
sort/insertionSort/250 20.26 ms 20.51 ms +1.2%
sort/insertionSort/300 29.74 ms 29.69 ms -0.2%
sort/mergeSort/50 704.1 μs 699.5 μs -0.7%
sort/mergeSort/100 1.624 ms 1.608 ms -1.0%
sort/mergeSort/150 2.613 ms 2.577 ms -1.4%
sort/mergeSort/200 3.671 ms 3.639 ms -0.9%
sort/mergeSort/250 4.825 ms 4.767 ms -1.2%
sort/mergeSort/300 5.875 ms 5.814 ms -1.0%
sort/quickSort/50 1.974 ms 1.961 ms -0.7%
sort/quickSort/100 7.981 ms 7.937 ms -0.6%
sort/quickSort/150 17.99 ms 17.81 ms -1.0%
sort/quickSort/200 31.84 ms 31.62 ms -0.7%
sort/quickSort/250 49.87 ms 49.61 ms -0.5%
sort/quickSort/300 72.05 ms 71.58 ms -0.7%
sum/compiled-from-Haskell/sum-right-builtin/100 97.11 μs 98.18 μs +1.1%
sum/compiled-from-Haskell/sum-right-builtin/500 508.0 μs 516.3 μs +1.6%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.099 ms 1.112 ms +1.2%
sum/compiled-from-Haskell/sum-right-builtin/2500 3.353 ms 3.394 ms +1.2%
sum/compiled-from-Haskell/sum-right-builtin/5000 7.190 ms 7.252 ms +0.9%
sum/compiled-from-Haskell/sum-right-Scott/100 64.63 μs 63.99 μs -1.0%
sum/compiled-from-Haskell/sum-right-Scott/500 336.5 μs 335.1 μs -0.4%
sum/compiled-from-Haskell/sum-right-Scott/1000 725.2 μs 722.5 μs -0.4%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.421 ms 2.405 ms -0.7%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.446 ms 5.419 ms -0.5%
sum/compiled-from-Haskell/sum-right-data/100 258.2 μs 262.6 μs +1.7%
sum/compiled-from-Haskell/sum-right-data/500 1.412 ms 1.398 ms -1.0%
sum/compiled-from-Haskell/sum-right-data/1000 3.165 ms 3.098 ms -2.1%
sum/compiled-from-Haskell/sum-right-data/2500 8.561 ms 8.305 ms -3.0%
sum/compiled-from-Haskell/sum-right-data/5000 17.73 ms 17.24 ms -2.8%
sum/compiled-from-Haskell/sum-left-builtin/100 95.14 μs 94.16 μs -1.0%
sum/compiled-from-Haskell/sum-left-builtin/500 495.7 μs 494.0 μs -0.3%
sum/compiled-from-Haskell/sum-left-builtin/1000 1.062 ms 1.052 ms -0.9%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.248 ms 3.195 ms -1.6%
sum/compiled-from-Haskell/sum-left-builtin/5000 7.057 ms 6.907 ms -2.1%
sum/compiled-from-Haskell/sum-left-Scott/100 62.69 μs 60.69 μs -3.2%
sum/compiled-from-Haskell/sum-left-Scott/500 327.7 μs 317.7 μs -3.1%
sum/compiled-from-Haskell/sum-left-Scott/1000 709.5 μs 685.0 μs -3.5%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.287 ms 2.220 ms -2.9%
sum/compiled-from-Haskell/sum-left-Scott/5000 5.157 ms 5.017 ms -2.7%
sum/compiled-from-Haskell/sum-left-data/100 260.2 μs 255.4 μs -1.8%
sum/compiled-from-Haskell/sum-left-data/500 1.416 ms 1.388 ms -2.0%
sum/compiled-from-Haskell/sum-left-data/1000 3.190 ms 3.114 ms -2.4%
sum/compiled-from-Haskell/sum-left-data/2500 8.563 ms 8.363 ms -2.3%
sum/compiled-from-Haskell/sum-left-data/5000 17.67 ms 17.26 ms -2.3%
sum/hand-written-PLC/sum-right-builtin/100 92.73 μs 94.96 μs +2.4%
sum/hand-written-PLC/sum-right-builtin/500 469.5 μs 479.6 μs +2.2%
sum/hand-written-PLC/sum-right-builtin/1000 970.8 μs 993.8 μs +2.4%
sum/hand-written-PLC/sum-right-builtin/2500 2.707 ms 2.760 ms +2.0%
sum/hand-written-PLC/sum-right-builtin/5000 5.692 ms 5.753 ms +1.1%
sum/hand-written-PLC/sum-right-Scott/100 52.29 μs 51.83 μs -0.9%
sum/hand-written-PLC/sum-right-Scott/500 268.5 μs 264.8 μs -1.4%
sum/hand-written-PLC/sum-right-Scott/1000 561.7 μs 550.0 μs -2.1%
sum/hand-written-PLC/sum-right-Scott/2500 1.713 ms 1.687 ms -1.5%
sum/hand-written-PLC/sum-right-Scott/5000 3.996 ms 3.991 ms -0.1%
sum/hand-written-PLC/sum-left-builtin/100 96.18 μs 98.62 μs +2.5%
sum/hand-written-PLC/sum-left-builtin/500 476.8 μs 484.3 μs +1.6%
sum/hand-written-PLC/sum-left-builtin/1000 950.0 μs 961.4 μs +1.2%
sum/hand-written-PLC/sum-left-builtin/2500 2.360 ms 2.394 ms +1.4%
sum/hand-written-PLC/sum-left-builtin/5000 4.703 ms 4.769 ms +1.4%
sum/hand-written-PLC/sum-left-Scott/100 57.14 μs 56.77 μs -0.6%
sum/hand-written-PLC/sum-left-Scott/500 284.8 μs 280.9 μs -1.4%
sum/hand-written-PLC/sum-left-Scott/1000 580.4 μs 576.0 μs -0.8%
sum/hand-written-PLC/sum-left-Scott/2500 1.624 ms 1.609 ms -0.9%
sum/hand-written-PLC/sum-left-Scott/5000 3.552 ms 3.521 ms -0.9%
TOTAL 417.4 ms 414.6 ms -0.7%

@effectfully
Copy link
Contributor Author

/benchmark lists

2 similar comments
@effectfully
Copy link
Contributor Author

/benchmark lists

@effectfully
Copy link
Contributor Author

/benchmark lists

Copy link
Contributor

github-actions bot commented Sep 3, 2024

Click here to check the status of your benchmark.

Copy link
Contributor

github-actions bot commented Sep 3, 2024

Comparing benchmark results of 'lists' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
sort/ghcSort/50 239.3 μs 230.4 μs -3.7%
sort/ghcSort/100 558.4 μs 532.8 μs -4.6%
sort/ghcSort/150 972.2 μs 927.5 μs -4.6%
sort/ghcSort/200 1.300 ms 1.247 ms -4.1%
sort/ghcSort/250 1.684 ms 1.614 ms -4.2%
sort/ghcSort/300 2.216 ms 2.115 ms -4.6%
sort/insertionSort/50 813.8 μs 780.0 μs -4.2%
sort/insertionSort/100 3.245 ms 3.108 ms -4.2%
sort/insertionSort/150 7.313 ms 7.013 ms -4.1%
sort/insertionSort/200 13.04 ms 12.54 ms -3.8%
sort/insertionSort/250 20.50 ms 19.68 ms -4.0%
sort/insertionSort/300 29.78 ms 28.55 ms -4.1%
sort/mergeSort/50 704.5 μs 672.1 μs -4.6%
sort/mergeSort/100 1.624 ms 1.545 ms -4.9%
sort/mergeSort/150 2.618 ms 2.492 ms -4.8%
sort/mergeSort/200 3.669 ms 3.510 ms -4.3%
sort/mergeSort/250 4.820 ms 4.613 ms -4.3%
sort/mergeSort/300 5.861 ms 5.608 ms -4.3%
sort/quickSort/50 1.968 ms 1.903 ms -3.3%
sort/quickSort/100 7.964 ms 7.692 ms -3.4%
sort/quickSort/150 17.88 ms 17.35 ms -3.0%
sort/quickSort/200 31.78 ms 30.74 ms -3.3%
sort/quickSort/250 49.82 ms 48.24 ms -3.2%
sort/quickSort/300 71.86 ms 69.56 ms -3.2%
sum/compiled-from-Haskell/sum-right-builtin/100 97.05 μs 95.24 μs -1.9%
sum/compiled-from-Haskell/sum-right-builtin/500 508.2 μs 502.5 μs -1.1%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.095 ms 1.083 ms -1.1%
sum/compiled-from-Haskell/sum-right-builtin/2500 3.341 ms 3.306 ms -1.0%
sum/compiled-from-Haskell/sum-right-builtin/5000 7.142 ms 7.069 ms -1.0%
sum/compiled-from-Haskell/sum-right-Scott/100 64.50 μs 62.39 μs -3.3%
sum/compiled-from-Haskell/sum-right-Scott/500 336.6 μs 325.9 μs -3.2%
sum/compiled-from-Haskell/sum-right-Scott/1000 720.7 μs 701.5 μs -2.7%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.412 ms 2.340 ms -3.0%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.415 ms 5.272 ms -2.6%
sum/compiled-from-Haskell/sum-right-data/100 258.0 μs 250.8 μs -2.8%
sum/compiled-from-Haskell/sum-right-data/500 1.409 ms 1.376 ms -2.3%
sum/compiled-from-Haskell/sum-right-data/1000 3.162 ms 3.094 ms -2.2%
sum/compiled-from-Haskell/sum-right-data/2500 8.538 ms 8.343 ms -2.3%
sum/compiled-from-Haskell/sum-right-data/5000 17.69 ms 17.33 ms -2.0%
sum/compiled-from-Haskell/sum-left-builtin/100 94.85 μs 93.81 μs -1.1%
sum/compiled-from-Haskell/sum-left-builtin/500 493.7 μs 491.3 μs -0.5%
sum/compiled-from-Haskell/sum-left-builtin/1000 1.058 ms 1.046 ms -1.1%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.241 ms 3.184 ms -1.8%
sum/compiled-from-Haskell/sum-left-builtin/5000 7.056 ms 6.938 ms -1.7%
sum/compiled-from-Haskell/sum-left-Scott/100 62.44 μs 60.83 μs -2.6%
sum/compiled-from-Haskell/sum-left-Scott/500 327.4 μs 320.2 μs -2.2%
sum/compiled-from-Haskell/sum-left-Scott/1000 705.1 μs 690.4 μs -2.1%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.279 ms 2.231 ms -2.1%
sum/compiled-from-Haskell/sum-left-Scott/5000 5.143 ms 5.039 ms -2.0%
sum/compiled-from-Haskell/sum-left-data/100 260.3 μs 255.7 μs -1.8%
sum/compiled-from-Haskell/sum-left-data/500 1.416 ms 1.391 ms -1.8%
sum/compiled-from-Haskell/sum-left-data/1000 3.177 ms 3.128 ms -1.5%
sum/compiled-from-Haskell/sum-left-data/2500 8.552 ms 8.412 ms -1.6%
sum/compiled-from-Haskell/sum-left-data/5000 17.65 ms 17.40 ms -1.4%
sum/hand-written-PLC/sum-right-builtin/100 92.30 μs 95.45 μs +3.4%
sum/hand-written-PLC/sum-right-builtin/500 468.3 μs 482.5 μs +3.0%
sum/hand-written-PLC/sum-right-builtin/1000 968.0 μs 996.6 μs +3.0%
sum/hand-written-PLC/sum-right-builtin/2500 2.698 ms 2.760 ms +2.3%
sum/hand-written-PLC/sum-right-builtin/5000 5.664 ms 5.794 ms +2.3%
sum/hand-written-PLC/sum-right-Scott/100 52.04 μs 52.78 μs +1.4%
sum/hand-written-PLC/sum-right-Scott/500 267.8 μs 266.4 μs -0.5%
sum/hand-written-PLC/sum-right-Scott/1000 560.7 μs 558.3 μs -0.4%
sum/hand-written-PLC/sum-right-Scott/2500 1.704 ms 1.711 ms +0.4%
sum/hand-written-PLC/sum-right-Scott/5000 3.992 ms 3.991 ms -0.0%
sum/hand-written-PLC/sum-left-builtin/100 96.73 μs 98.42 μs +1.7%
sum/hand-written-PLC/sum-left-builtin/500 475.8 μs 485.0 μs +1.9%
sum/hand-written-PLC/sum-left-builtin/1000 948.9 μs 964.6 μs +1.7%
sum/hand-written-PLC/sum-left-builtin/2500 2.368 ms 2.403 ms +1.5%
sum/hand-written-PLC/sum-left-builtin/5000 4.716 ms 4.808 ms +2.0%
sum/hand-written-PLC/sum-left-Scott/100 56.86 μs 56.91 μs +0.1%
sum/hand-written-PLC/sum-left-Scott/500 284.0 μs 283.2 μs -0.3%
sum/hand-written-PLC/sum-left-Scott/1000 580.1 μs 578.6 μs -0.3%
sum/hand-written-PLC/sum-left-Scott/2500 1.621 ms 1.630 ms +0.6%
sum/hand-written-PLC/sum-left-Scott/5000 3.550 ms 3.557 ms +0.2%
TOTAL 417.1 ms 405.7 ms -2.7%

Copy link
Contributor

github-actions bot commented Sep 3, 2024

Click here to check the status of your benchmark.

Copy link
Contributor

github-actions bot commented Sep 3, 2024

Comparing benchmark results of 'lists' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
sort/ghcSort/50 237.9 μs 243.6 μs +2.4%
sort/ghcSort/100 556.2 μs 568.2 μs +2.2%
sort/ghcSort/150 967.4 μs 984.4 μs +1.8%
sort/ghcSort/200 1.297 ms 1.343 ms +3.5%
sort/ghcSort/250 1.678 ms 1.735 ms +3.4%
sort/ghcSort/300 2.213 ms 2.278 ms +2.9%
sort/insertionSort/50 810.3 μs 846.6 μs +4.5%
sort/insertionSort/100 3.249 ms 3.367 ms +3.6%
sort/insertionSort/150 7.288 ms 7.590 ms +4.1%
sort/insertionSort/200 12.99 ms 13.55 ms +4.3%
sort/insertionSort/250 20.40 ms 21.78 ms +6.8%
sort/insertionSort/300 29.52 ms 30.79 ms +4.3%
sort/mergeSort/50 701.6 μs 722.4 μs +3.0%
sort/mergeSort/100 1.626 ms 1.662 ms +2.2%
sort/mergeSort/150 2.600 ms 2.670 ms +2.7%
sort/mergeSort/200 3.657 ms 3.757 ms +2.7%
sort/mergeSort/250 4.710 ms 4.921 ms +4.5%
sort/mergeSort/300 5.742 ms 5.995 ms +4.4%
sort/quickSort/50 1.924 ms 2.028 ms +5.4%
sort/quickSort/100 7.806 ms 8.185 ms +4.9%
sort/quickSort/150 17.55 ms 18.43 ms +5.0%
sort/quickSort/200 31.08 ms 32.65 ms +5.1%
sort/quickSort/250 48.85 ms 51.16 ms +4.7%
sort/quickSort/300 70.27 ms 73.70 ms +4.9%
sum/compiled-from-Haskell/sum-right-builtin/100 94.68 μs 104.0 μs +9.8%
sum/compiled-from-Haskell/sum-right-builtin/500 496.8 μs 544.3 μs +9.6%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.075 ms 1.165 ms +8.4%
sum/compiled-from-Haskell/sum-right-builtin/2500 3.281 ms 3.544 ms +8.0%
sum/compiled-from-Haskell/sum-right-builtin/5000 7.009 ms 7.533 ms +7.5%
sum/compiled-from-Haskell/sum-right-Scott/100 63.02 μs 65.11 μs +3.3%
sum/compiled-from-Haskell/sum-right-Scott/500 331.1 μs 340.8 μs +2.9%
sum/compiled-from-Haskell/sum-right-Scott/1000 711.7 μs 732.3 μs +2.9%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.385 ms 2.431 ms +1.9%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.347 ms 5.476 ms +2.4%
sum/compiled-from-Haskell/sum-right-data/100 255.5 μs 273.9 μs +7.2%
sum/compiled-from-Haskell/sum-right-data/500 1.394 ms 1.468 ms +5.3%
sum/compiled-from-Haskell/sum-right-data/1000 3.130 ms 3.285 ms +5.0%
sum/compiled-from-Haskell/sum-right-data/2500 8.584 ms 8.835 ms +2.9%
sum/compiled-from-Haskell/sum-right-data/5000 17.73 ms 18.30 ms +3.2%
sum/compiled-from-Haskell/sum-left-builtin/100 94.88 μs 101.8 μs +7.3%
sum/compiled-from-Haskell/sum-left-builtin/500 494.3 μs 532.2 μs +7.7%
sum/compiled-from-Haskell/sum-left-builtin/1000 1.063 ms 1.133 ms +6.6%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.252 ms 3.401 ms +4.6%
sum/compiled-from-Haskell/sum-left-builtin/5000 7.063 ms 7.363 ms +4.2%
sum/compiled-from-Haskell/sum-left-Scott/100 62.78 μs 64.86 μs +3.3%
sum/compiled-from-Haskell/sum-left-Scott/500 327.9 μs 339.2 μs +3.4%
sum/compiled-from-Haskell/sum-left-Scott/1000 708.7 μs 729.6 μs +2.9%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.284 ms 2.338 ms +2.4%
sum/compiled-from-Haskell/sum-left-Scott/5000 5.146 ms 5.262 ms +2.3%
sum/compiled-from-Haskell/sum-left-data/100 260.5 μs 275.0 μs +5.6%
sum/compiled-from-Haskell/sum-left-data/500 1.416 ms 1.485 ms +4.9%
sum/compiled-from-Haskell/sum-left-data/1000 3.180 ms 3.302 ms +3.8%
sum/compiled-from-Haskell/sum-left-data/2500 8.573 ms 8.855 ms +3.3%
sum/compiled-from-Haskell/sum-left-data/5000 17.66 ms 18.23 ms +3.2%
sum/hand-written-PLC/sum-right-builtin/100 92.52 μs 102.1 μs +10.4%
sum/hand-written-PLC/sum-right-builtin/500 470.0 μs 516.1 μs +9.8%
sum/hand-written-PLC/sum-right-builtin/1000 970.5 μs 1.058 ms +9.0%
sum/hand-written-PLC/sum-right-builtin/2500 2.706 ms 2.944 ms +8.8%
sum/hand-written-PLC/sum-right-builtin/5000 5.680 ms 6.152 ms +8.3%
sum/hand-written-PLC/sum-right-Scott/100 52.19 μs 53.86 μs +3.2%
sum/hand-written-PLC/sum-right-Scott/500 268.4 μs 269.8 μs +0.5%
sum/hand-written-PLC/sum-right-Scott/1000 559.9 μs 570.1 μs +1.8%
sum/hand-written-PLC/sum-right-Scott/2500 1.712 ms 1.728 ms +0.9%
sum/hand-written-PLC/sum-right-Scott/5000 4.015 ms 4.029 ms +0.3%
sum/hand-written-PLC/sum-left-builtin/100 96.49 μs 106.3 μs +10.2%
sum/hand-written-PLC/sum-left-builtin/500 477.1 μs 523.8 μs +9.8%
sum/hand-written-PLC/sum-left-builtin/1000 951.6 μs 1.040 ms +9.3%
sum/hand-written-PLC/sum-left-builtin/2500 2.369 ms 2.587 ms +9.2%
sum/hand-written-PLC/sum-left-builtin/5000 4.709 ms 5.150 ms +9.4%
sum/hand-written-PLC/sum-left-Scott/100 56.94 μs 58.66 μs +3.0%
sum/hand-written-PLC/sum-left-Scott/500 286.7 μs 290.5 μs +1.3%
sum/hand-written-PLC/sum-left-Scott/1000 582.0 μs 591.0 μs +1.5%
sum/hand-written-PLC/sum-left-Scott/2500 1.600 ms 1.649 ms +3.1%
sum/hand-written-PLC/sum-left-Scott/5000 3.501 ms 3.597 ms +2.7%
TOTAL 412.4 ms 431.5 ms +4.6%

Copy link
Contributor

github-actions bot commented Sep 3, 2024

Click here to check the status of your benchmark.

Copy link
Contributor

github-actions bot commented Sep 3, 2024

Comparing benchmark results of 'lists' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
sort/ghcSort/50 238.0 μs 236.3 μs -0.7%
sort/ghcSort/100 561.5 μs 549.8 μs -2.1%
sort/ghcSort/150 978.8 μs 954.6 μs -2.5%
sort/ghcSort/200 1.311 ms 1.288 ms -1.8%
sort/ghcSort/250 1.691 ms 1.662 ms -1.7%
sort/ghcSort/300 2.233 ms 2.184 ms -2.2%
sort/insertionSort/50 818.8 μs 802.6 μs -2.0%
sort/insertionSort/100 3.261 ms 3.206 ms -1.7%
sort/insertionSort/150 7.417 ms 7.232 ms -2.5%
sort/insertionSort/200 13.09 ms 12.92 ms -1.3%
sort/insertionSort/250 20.61 ms 20.20 ms -2.0%
sort/insertionSort/300 29.80 ms 29.21 ms -2.0%
sort/mergeSort/50 704.3 μs 690.9 μs -1.9%
sort/mergeSort/100 1.621 ms 1.584 ms -2.3%
sort/mergeSort/150 2.623 ms 2.555 ms -2.6%
sort/mergeSort/200 3.680 ms 3.582 ms -2.7%
sort/mergeSort/250 4.827 ms 4.707 ms -2.5%
sort/mergeSort/300 5.877 ms 5.721 ms -2.7%
sort/quickSort/50 1.972 ms 1.938 ms -1.7%
sort/quickSort/100 7.977 ms 7.819 ms -2.0%
sort/quickSort/150 17.99 ms 17.65 ms -1.9%
sort/quickSort/200 31.91 ms 31.18 ms -2.3%
sort/quickSort/250 50.03 ms 48.90 ms -2.3%
sort/quickSort/300 71.81 ms 70.36 ms -2.0%
sum/compiled-from-Haskell/sum-right-builtin/100 96.93 μs 96.72 μs -0.2%
sum/compiled-from-Haskell/sum-right-builtin/500 507.0 μs 508.3 μs +0.3%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.097 ms 1.110 ms +1.2%
sum/compiled-from-Haskell/sum-right-builtin/2500 3.348 ms 3.379 ms +0.9%
sum/compiled-from-Haskell/sum-right-builtin/5000 7.157 ms 7.227 ms +1.0%
sum/compiled-from-Haskell/sum-right-Scott/100 64.66 μs 64.26 μs -0.6%
sum/compiled-from-Haskell/sum-right-Scott/500 337.0 μs 335.1 μs -0.6%
sum/compiled-from-Haskell/sum-right-Scott/1000 711.5 μs 720.1 μs +1.2%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.408 ms 2.399 ms -0.4%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.450 ms 5.412 ms -0.7%
sum/compiled-from-Haskell/sum-right-data/100 258.3 μs 255.3 μs -1.2%
sum/compiled-from-Haskell/sum-right-data/500 1.411 ms 1.393 ms -1.3%
sum/compiled-from-Haskell/sum-right-data/1000 3.165 ms 3.129 ms -1.1%
sum/compiled-from-Haskell/sum-right-data/2500 8.559 ms 8.453 ms -1.2%
sum/compiled-from-Haskell/sum-right-data/5000 17.76 ms 17.51 ms -1.4%
sum/compiled-from-Haskell/sum-left-builtin/100 94.97 μs 94.83 μs -0.1%
sum/compiled-from-Haskell/sum-left-builtin/500 494.7 μs 497.0 μs +0.5%
sum/compiled-from-Haskell/sum-left-builtin/1000 1.059 ms 1.062 ms +0.3%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.254 ms 3.227 ms -0.8%
sum/compiled-from-Haskell/sum-left-builtin/5000 7.078 ms 7.025 ms -0.7%
sum/compiled-from-Haskell/sum-left-Scott/100 62.84 μs 61.73 μs -1.8%
sum/compiled-from-Haskell/sum-left-Scott/500 327.4 μs 323.5 μs -1.2%
sum/compiled-from-Haskell/sum-left-Scott/1000 707.6 μs 698.2 μs -1.3%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.283 ms 2.254 ms -1.3%
sum/compiled-from-Haskell/sum-left-Scott/5000 5.166 ms 5.091 ms -1.5%
sum/compiled-from-Haskell/sum-left-data/100 260.8 μs 258.5 μs -0.9%
sum/compiled-from-Haskell/sum-left-data/500 1.418 ms 1.408 ms -0.7%
sum/compiled-from-Haskell/sum-left-data/1000 3.187 ms 3.152 ms -1.1%
sum/compiled-from-Haskell/sum-left-data/2500 8.578 ms 8.456 ms -1.4%
sum/compiled-from-Haskell/sum-left-data/5000 17.67 ms 17.47 ms -1.1%
sum/hand-written-PLC/sum-right-builtin/100 92.73 μs 96.08 μs +3.6%
sum/hand-written-PLC/sum-right-builtin/500 469.5 μs 487.7 μs +3.9%
sum/hand-written-PLC/sum-right-builtin/1000 970.8 μs 998.6 μs +2.9%
sum/hand-written-PLC/sum-right-builtin/2500 2.721 ms 2.796 ms +2.8%
sum/hand-written-PLC/sum-right-builtin/5000 5.679 ms 5.868 ms +3.3%
sum/hand-written-PLC/sum-right-Scott/100 52.16 μs 53.34 μs +2.3%
sum/hand-written-PLC/sum-right-Scott/500 268.1 μs 268.4 μs +0.1%
sum/hand-written-PLC/sum-right-Scott/1000 561.6 μs 560.0 μs -0.3%
sum/hand-written-PLC/sum-right-Scott/2500 1.707 ms 1.723 ms +0.9%
sum/hand-written-PLC/sum-right-Scott/5000 4.009 ms 4.027 ms +0.4%
sum/hand-written-PLC/sum-left-builtin/100 96.92 μs 98.72 μs +1.9%
sum/hand-written-PLC/sum-left-builtin/500 479.2 μs 490.9 μs +2.4%
sum/hand-written-PLC/sum-left-builtin/1000 955.7 μs 972.8 μs +1.8%
sum/hand-written-PLC/sum-left-builtin/2500 2.371 ms 2.419 ms +2.0%
sum/hand-written-PLC/sum-left-builtin/5000 4.733 ms 4.821 ms +1.9%
sum/hand-written-PLC/sum-left-Scott/100 57.21 μs 58.14 μs +1.6%
sum/hand-written-PLC/sum-left-Scott/500 285.7 μs 283.6 μs -0.7%
sum/hand-written-PLC/sum-left-Scott/1000 583.2 μs 571.0 μs -2.1%
sum/hand-written-PLC/sum-left-Scott/2500 1.626 ms 1.597 ms -1.8%
sum/hand-written-PLC/sum-left-Scott/5000 3.556 ms 3.493 ms -1.8%
TOTAL 418.3 ms 411.9 ms -1.5%

@effectfully effectfully added the No Changelog Required Add this to skip the Changelog Check label Sep 3, 2024
@kwxm
Copy link
Contributor

kwxm commented Sep 11, 2024

/benchmark validation

@kwxm
Copy link
Contributor

kwxm commented Sep 11, 2024

/benchmark lists

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Click here to check the status of your benchmark.

@effectfully effectfully force-pushed the effectfully/builtins/make-unlifting-lazy-again branch from d635213 to 989b32c Compare September 11, 2024 16:03
@effectfully
Copy link
Contributor Author

@kwxm needed rebasing on master, I've now done it.

@effectfully
Copy link
Contributor Author

/benchmark validation

@effectfully
Copy link
Contributor Author

/benchmark lists

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'validation' on '1d2ad5ab88' (base) and '989b32c0e6' (PR)

Results table
Script 1d2ad5a 989b32c Change
auction_1-1 190.6 μs 187.5 μs -1.6%
auction_1-2 667.2 μs 664.2 μs -0.4%
auction_1-3 663.2 μs 657.7 μs -0.8%
auction_1-4 243.2 μs 239.5 μs -1.5%
auction_2-1 190.3 μs 185.2 μs -2.7%
auction_2-2 667.0 μs 661.4 μs -0.8%
auction_2-3 869.4 μs 866.6 μs -0.3%
auction_2-4 660.3 μs 657.9 μs -0.4%
auction_2-5 242.9 μs 246.7 μs +1.6%
crowdfunding-success-1 221.9 μs 217.4 μs -2.0%
crowdfunding-success-2 221.9 μs 217.7 μs -1.9%
crowdfunding-success-3 221.7 μs 214.7 μs -3.2%
currency-1 252.1 μs 252.4 μs +0.1%
escrow-redeem_1-1 357.3 μs 356.1 μs -0.3%
escrow-redeem_1-2 356.4 μs 353.7 μs -0.8%
escrow-redeem_2-1 417.9 μs 413.7 μs -1.0%
escrow-redeem_2-2 417.6 μs 412.9 μs -1.1%
escrow-redeem_2-3 418.0 μs 413.2 μs -1.1%
escrow-refund-1 160.8 μs 157.0 μs -2.4%
future-increase-margin-1 252.5 μs 252.4 μs -0.0%
future-increase-margin-2 549.3 μs 553.6 μs +0.8%
future-increase-margin-3 549.7 μs 553.4 μs +0.7%
future-increase-margin-4 501.5 μs 501.2 μs -0.1%
future-increase-margin-5 823.4 μs 836.3 μs +1.6%
future-pay-out-1 254.3 μs 255.9 μs +0.6%
future-pay-out-2 559.5 μs 559.5 μs 0.0%
future-pay-out-3 561.0 μs 559.3 μs -0.3%
future-pay-out-4 839.2 μs 841.7 μs +0.3%
future-settle-early-1 257.6 μs 256.2 μs -0.5%
future-settle-early-2 560.9 μs 559.5 μs -0.2%
future-settle-early-3 559.8 μs 559.4 μs -0.1%
future-settle-early-4 629.5 μs 628.1 μs -0.2%
game-sm-success_1-1 403.5 μs 398.0 μs -1.4%
game-sm-success_1-2 211.9 μs 207.8 μs -1.9%
game-sm-success_1-3 660.9 μs 662.5 μs +0.2%
game-sm-success_1-4 242.7 μs 235.9 μs -2.8%
game-sm-success_2-1 403.6 μs 399.3 μs -1.1%
game-sm-success_2-2 211.7 μs 203.4 μs -3.9%
game-sm-success_2-3 661.9 μs 647.2 μs -2.2%
game-sm-success_2-4 241.2 μs 231.7 μs -3.9%
game-sm-success_2-5 662.5 μs 647.0 μs -2.3%
game-sm-success_2-6 241.0 μs 230.1 μs -4.5%
multisig-sm-1 405.5 μs 398.8 μs -1.7%
multisig-sm-2 393.6 μs 391.9 μs -0.4%
multisig-sm-3 397.5 μs 391.9 μs -1.4%
multisig-sm-4 402.5 μs 398.6 μs -1.0%
multisig-sm-5 571.7 μs 563.7 μs -1.4%
multisig-sm-6 409.1 μs 397.6 μs -2.8%
multisig-sm-7 399.8 μs 393.2 μs -1.7%
multisig-sm-8 402.2 μs 396.5 μs -1.4%
multisig-sm-9 407.2 μs 396.6 μs -2.6%
multisig-sm-10 566.4 μs 565.5 μs -0.2%
ping-pong-1 332.0 μs 332.7 μs +0.2%
ping-pong-2 330.9 μs 331.3 μs +0.1%
ping-pong_2-1 204.0 μs 201.0 μs -1.5%
prism-1 174.4 μs 170.3 μs -2.4%
prism-2 420.5 μs 417.0 μs -0.8%
prism-3 372.5 μs 373.5 μs +0.3%
pubkey-1 148.0 μs 144.8 μs -2.2%
stablecoin_1-1 918.9 μs 912.9 μs -0.7%
stablecoin_1-2 202.3 μs 198.8 μs -1.7%
stablecoin_1-3 1.056 ms 1.060 ms +0.4%
stablecoin_1-4 215.2 μs 212.9 μs -1.1%
stablecoin_1-5 1.364 ms 1.363 ms -0.1%
stablecoin_1-6 268.4 μs 263.6 μs -1.8%
stablecoin_2-1 929.5 μs 929.0 μs -0.1%
stablecoin_2-2 205.4 μs 201.7 μs -1.8%
stablecoin_2-3 1.082 ms 1.070 ms -1.1%
stablecoin_2-4 219.9 μs 214.3 μs -2.5%
token-account-1 197.9 μs 195.3 μs -1.3%
token-account-2 353.7 μs 345.2 μs -2.4%
uniswap-1 426.3 μs 420.7 μs -1.3%
uniswap-2 230.0 μs 227.0 μs -1.3%
uniswap-3 1.807 ms 1.792 ms -0.8%
uniswap-4 351.0 μs 346.1 μs -1.4%
uniswap-5 1.200 ms 1.185 ms -1.2%
uniswap-6 339.7 μs 328.1 μs -3.4%
vesting-1 359.8 μs 358.9 μs -0.3%

| :------| :------: | :------: | :------: |
| TOTAL | 36.34 ms | 36.04 ms | -0.8% |

Copy link
Contributor

Click here to check the status of your benchmark.

@effectfully
Copy link
Contributor Author

@kwxm it works! Thank you. Did you want to make it this though:

Script 1d2ad5a 989b32c Change
TOTAL 36.34 ms 36.04 ms -0.8%

?

Copy link
Contributor

Comparing benchmark results of 'lists' on '1d2ad5ab88' (base) and '989b32c0e6' (PR)

Results table
Script 1d2ad5a 989b32c Change
sort/ghcSort/50 240.3 μs 238.9 μs -0.6%
sort/ghcSort/100 559.8 μs 556.4 μs -0.6%
sort/ghcSort/150 970.3 μs 967.4 μs -0.3%
sort/ghcSort/200 1.281 ms 1.304 ms +1.8%
sort/ghcSort/250 1.672 ms 1.680 ms +0.5%
sort/ghcSort/300 2.200 ms 2.209 ms +0.4%
sort/insertionSort/50 824.0 μs 808.9 μs -1.8%
sort/insertionSort/100 3.285 ms 3.234 ms -1.6%
sort/insertionSort/150 7.415 ms 7.308 ms -1.4%
sort/insertionSort/200 13.21 ms 13.03 ms -1.4%
sort/insertionSort/250 20.74 ms 20.46 ms -1.4%
sort/insertionSort/300 30.02 ms 29.73 ms -1.0%
sort/mergeSort/50 701.1 μs 706.6 μs +0.8%
sort/mergeSort/100 1.609 ms 1.628 ms +1.2%
sort/mergeSort/150 2.597 ms 2.617 ms +0.8%
sort/mergeSort/200 3.627 ms 3.672 ms +1.2%
sort/mergeSort/250 4.766 ms 4.818 ms +1.1%
sort/mergeSort/300 5.809 ms 5.878 ms +1.2%
sort/quickSort/50 1.936 ms 1.989 ms +2.7%
sort/quickSort/100 7.836 ms 8.038 ms +2.6%
sort/quickSort/150 17.58 ms 18.10 ms +3.0%
sort/quickSort/200 31.19 ms 32.07 ms +2.8%
sort/quickSort/250 48.90 ms 50.33 ms +2.9%
sort/quickSort/300 70.61 ms 72.55 ms +2.7%
sum/compiled-from-Haskell/sum-right-builtin/100 95.90 μs 98.82 μs +3.0%
sum/compiled-from-Haskell/sum-right-builtin/500 502.9 μs 518.7 μs +3.1%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.089 ms 1.116 ms +2.5%
sum/compiled-from-Haskell/sum-right-builtin/2500 3.335 ms 3.407 ms +2.2%
sum/compiled-from-Haskell/sum-right-builtin/5000 7.128 ms 7.275 ms +2.1%
sum/compiled-from-Haskell/sum-right-Scott/100 63.35 μs 65.28 μs +3.0%
sum/compiled-from-Haskell/sum-right-Scott/500 331.1 μs 340.9 μs +3.0%
sum/compiled-from-Haskell/sum-right-Scott/1000 714.5 μs 734.0 μs +2.7%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.391 ms 2.440 ms +2.0%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.394 ms 5.494 ms +1.9%
sum/compiled-from-Haskell/sum-right-data/100 250.8 μs 261.8 μs +4.4%
sum/compiled-from-Haskell/sum-right-data/500 1.369 ms 1.423 ms +3.9%
sum/compiled-from-Haskell/sum-right-data/1000 3.099 ms 3.187 ms +2.8%
sum/compiled-from-Haskell/sum-right-data/2500 8.375 ms 8.590 ms +2.6%
sum/compiled-from-Haskell/sum-right-data/5000 17.30 ms 17.81 ms +2.9%
sum/compiled-from-Haskell/sum-left-builtin/100 92.15 μs 96.08 μs +4.3%
sum/compiled-from-Haskell/sum-left-builtin/500 483.1 μs 502.3 μs +4.0%
sum/compiled-from-Haskell/sum-left-builtin/1000 1.038 ms 1.073 ms +3.4%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.184 ms 3.264 ms +2.5%
sum/compiled-from-Haskell/sum-left-builtin/5000 6.934 ms 7.083 ms +2.1%
sum/compiled-from-Haskell/sum-left-Scott/100 60.93 μs 63.80 μs +4.7%
sum/compiled-from-Haskell/sum-left-Scott/500 320.7 μs 333.0 μs +3.8%
sum/compiled-from-Haskell/sum-left-Scott/1000 691.8 μs 717.3 μs +3.7%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.248 ms 2.302 ms +2.4%
sum/compiled-from-Haskell/sum-left-Scott/5000 5.093 ms 5.204 ms +2.2%
sum/compiled-from-Haskell/sum-left-data/100 255.3 μs 264.1 μs +3.4%
sum/compiled-from-Haskell/sum-left-data/500 1.394 ms 1.440 ms +3.3%
sum/compiled-from-Haskell/sum-left-data/1000 3.134 ms 3.213 ms +2.5%
sum/compiled-from-Haskell/sum-left-data/2500 8.415 ms 8.641 ms +2.7%
sum/compiled-from-Haskell/sum-left-data/5000 17.36 ms 17.82 ms +2.6%
sum/hand-written-PLC/sum-right-builtin/100 93.27 μs 95.41 μs +2.3%
sum/hand-written-PLC/sum-right-builtin/500 476.8 μs 483.4 μs +1.4%
sum/hand-written-PLC/sum-right-builtin/1000 983.4 μs 1.001 ms +1.8%
sum/hand-written-PLC/sum-right-builtin/2500 2.740 ms 2.780 ms +1.5%
sum/hand-written-PLC/sum-right-builtin/5000 5.742 ms 5.821 ms +1.4%
sum/hand-written-PLC/sum-right-Scott/100 50.89 μs 54.09 μs +6.3%
sum/hand-written-PLC/sum-right-Scott/500 261.1 μs 276.6 μs +5.9%
sum/hand-written-PLC/sum-right-Scott/1000 544.2 μs 576.0 μs +5.8%
sum/hand-written-PLC/sum-right-Scott/2500 1.657 ms 1.736 ms +4.8%
sum/hand-written-PLC/sum-right-Scott/5000 3.900 ms 4.052 ms +3.9%
sum/hand-written-PLC/sum-left-builtin/100 97.07 μs 98.74 μs +1.7%
sum/hand-written-PLC/sum-left-builtin/500 480.6 μs 480.7 μs +0.0%
sum/hand-written-PLC/sum-left-builtin/1000 953.6 μs 963.1 μs +1.0%
sum/hand-written-PLC/sum-left-builtin/2500 2.370 ms 2.394 ms +1.0%
sum/hand-written-PLC/sum-left-builtin/5000 4.711 ms 4.782 ms +1.5%
sum/hand-written-PLC/sum-left-Scott/100 56.27 μs 59.05 μs +4.9%
sum/hand-written-PLC/sum-left-Scott/500 279.1 μs 291.8 μs +4.6%
sum/hand-written-PLC/sum-left-Scott/1000 566.8 μs 594.0 μs +4.8%
sum/hand-written-PLC/sum-left-Scott/2500 1.588 ms 1.624 ms +2.3%
sum/hand-written-PLC/sum-left-Scott/5000 3.481 ms 3.557 ms +2.2%

| :------| :------: | :------: | :------: |
| TOTAL | 412.8 ms | 420.4 ms | +1.9% |

…to effectfully/builtins/make-unlifting-lazy-again
@effectfully
Copy link
Contributor Author

/benchmark validation

@effectfully
Copy link
Contributor Author

/benchmark nofib

@effectfully
Copy link
Contributor Author

/benchmark lists

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'validation' on '24e3cfc0f' (base) and '74b1b772e' (PR)

Results table
Script 24e3cfc 74b1b77 Change
auction_1-1 258.2 μs 180.5 μs -30.1%
auction_1-2 912.7 μs 640.8 μs -29.8%
auction_1-3 895.2 μs 762.6 μs -14.8%
auction_1-4 333.6 μs 327.6 μs -1.8%
auction_2-1 181.1 μs 185.3 μs +2.3%
auction_2-2 647.8 μs 639.5 μs -1.3%
auction_2-3 1.213 ms 834.1 μs -31.2%
auction_2-4 898.3 μs 632.1 μs -29.6%
auction_2-5 334.6 μs 229.6 μs -31.4%
crowdfunding-success-1 298.5 μs 210.8 μs -29.4%
crowdfunding-success-2 299.1 μs 282.3 μs -5.6%
crowdfunding-success-3 299.1 μs 299.1 μs 0.0%
currency-1 353.5 μs 351.8 μs -0.5%
escrow-redeem_1-1 502.0 μs 387.8 μs -22.7%
escrow-redeem_1-2 493.4 μs 346.0 μs -29.9%
escrow-redeem_2-1 585.9 μs 408.5 μs -30.3%
escrow-redeem_2-2 585.9 μs 408.1 μs -30.3%
escrow-redeem_2-3 585.1 μs 410.4 μs -29.9%
escrow-refund-1 223.1 μs 183.3 μs -17.8%
future-increase-margin-1 353.6 μs 352.9 μs -0.2%
future-increase-margin-2 769.4 μs 765.6 μs -0.5%
future-increase-margin-3 768.5 μs 763.2 μs -0.7%
future-increase-margin-4 698.4 μs 483.3 μs -30.8%
future-increase-margin-5 1.159 ms 805.7 μs -30.5%
future-pay-out-1 354.0 μs 352.9 μs -0.3%
future-pay-out-2 764.8 μs 764.2 μs -0.1%
future-pay-out-3 765.4 μs 764.4 μs -0.1%
future-pay-out-4 1.153 ms 1.023 ms -11.3%
future-settle-early-1 353.7 μs 356.0 μs +0.7%
future-settle-early-2 767.8 μs 763.8 μs -0.5%
future-settle-early-3 767.2 μs 766.6 μs -0.1%
future-settle-early-4 867.9 μs 801.9 μs -7.6%
game-sm-success_1-1 554.2 μs 549.4 μs -0.9%
game-sm-success_1-2 287.8 μs 279.0 μs -3.1%
game-sm-success_1-3 909.2 μs 907.5 μs -0.2%
game-sm-success_1-4 333.2 μs 320.6 μs -3.8%
game-sm-success_2-1 552.8 μs 550.6 μs -0.4%
game-sm-success_2-2 291.4 μs 201.8 μs -30.7%
game-sm-success_2-3 906.5 μs 642.6 μs -29.1%
game-sm-success_2-4 332.6 μs 226.0 μs -32.1%
game-sm-success_2-5 908.4 μs 638.7 μs -29.7%
game-sm-success_2-6 332.8 μs 226.4 μs -32.0%
multisig-sm-1 563.5 μs 396.3 μs -29.7%
multisig-sm-2 546.2 μs 419.4 μs -23.2%
multisig-sm-3 390.5 μs 390.8 μs +0.1%
multisig-sm-4 566.1 μs 394.6 μs -30.3%
multisig-sm-5 789.6 μs 557.3 μs -29.4%
multisig-sm-6 565.4 μs 395.5 μs -30.0%
multisig-sm-7 544.2 μs 386.6 μs -29.0%
multisig-sm-8 558.8 μs 391.9 μs -29.9%
multisig-sm-9 559.1 μs 395.9 μs -29.2%
multisig-sm-10 789.8 μs 557.8 μs -29.4%
ping-pong-1 469.5 μs 330.7 μs -29.6%
ping-pong-2 472.9 μs 329.2 μs -30.4%
ping-pong_2-1 198.9 μs 199.4 μs +0.3%
prism-1 205.6 μs 168.4 μs -18.1%
prism-2 590.7 μs 410.4 μs -30.5%
prism-3 523.0 μs 366.4 μs -29.9%
pubkey-1 202.9 μs 141.8 μs -30.1%
stablecoin_1-1 1.285 ms 903.4 μs -29.7%
stablecoin_1-2 280.5 μs 194.8 μs -30.6%
stablecoin_1-3 1.495 ms 1.039 ms -30.5%
stablecoin_1-4 296.6 μs 205.7 μs -30.6%
stablecoin_1-5 1.922 ms 1.335 ms -30.5%
stablecoin_1-6 364.7 μs 254.9 μs -30.1%
stablecoin_2-1 1.300 ms 902.9 μs -30.5%
stablecoin_2-2 279.8 μs 194.1 μs -30.6%
stablecoin_2-3 1.475 ms 1.042 ms -29.4%
stablecoin_2-4 295.3 μs 205.3 μs -30.5%
token-account-1 191.5 μs 189.7 μs -0.9%
token-account-2 338.9 μs 335.7 μs -0.9%
uniswap-1 414.6 μs 414.1 μs -0.1%
uniswap-2 221.8 μs 233.6 μs +5.3%
uniswap-3 1.752 ms 1.741 ms -0.6%
uniswap-4 337.1 μs 479.9 μs +42.4%
uniswap-5 1.158 ms 1.626 ms +40.4%
uniswap-6 322.4 μs 452.1 μs +40.2%
vesting-1 350.4 μs 496.8 μs +41.8%
24e3cfc 74b1b77 Change
TOTAL 47.47 ms 39.50 ms -16.8%

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'nofib' on '24e3cfc0f' (base) and '74b1b772e' (PR)

Results table
Script 24e3cfc 74b1b77 Change
clausify/formula1 4.294 ms 4.409 ms +2.7%
clausify/formula2 5.765 ms 5.787 ms +0.4%
clausify/formula3 15.35 ms 15.82 ms +3.1%
clausify/formula4 24.87 ms 36.12 ms +45.2%
clausify/formula5 53.93 ms 76.80 ms +42.4%
knights/4x4 17.34 ms 24.74 ms +42.7%
knights/6x6 45.54 ms 65.31 ms +43.4%
knights/8x8 121.2 ms 114.8 ms -5.3%
primetest/05digits 9.727 ms 14.46 ms +48.7%
primetest/10digits 19.82 ms 28.15 ms +42.0%
primetest/30digits 68.16 ms 87.37 ms +28.2%
primetest/50digits 141.0 ms 144.1 ms +2.2%
queens4x4/bt 7.505 ms 7.572 ms +0.9%
queens4x4/bm 9.433 ms 9.608 ms +1.9%
queens4x4/bjbt1 9.129 ms 9.220 ms +1.0%
queens4x4/bjbt2 8.537 ms 8.622 ms +1.0%
queens4x4/fc 19.18 ms 19.47 ms +1.5%
queens5x5/bt 102.2 ms 103.0 ms +0.8%
queens5x5/bm 106.1 ms 107.9 ms +1.7%
queens5x5/bjbt1 119.4 ms 119.9 ms +0.4%
queens5x5/bjbt2 115.8 ms 74.04 ms -36.1%
queens5x5/fc 243.5 ms 187.9 ms -22.8%
24e3cfc 74b1b77 Change
TOTAL 1.268 s 1.265 s -0.2%

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'lists' on '24e3cfc0f' (base) and '74b1b772e' (PR)

Results table
Script 24e3cfc 74b1b77 Change
sort/ghcSort/50 334.6 μs 330.9 μs -1.1%
sort/ghcSort/100 681.2 μs 771.1 μs +13.2%
sort/ghcSort/150 950.6 μs 1.333 ms +40.2%
sort/ghcSort/200 1.278 ms 1.795 ms +40.5%
sort/ghcSort/250 1.655 ms 2.322 ms +40.3%
sort/ghcSort/300 2.170 ms 3.044 ms +40.3%
sort/insertionSort/50 783.7 μs 1.102 ms +40.6%
sort/insertionSort/100 3.131 ms 4.393 ms +40.3%
sort/insertionSort/150 7.052 ms 9.928 ms +40.8%
sort/insertionSort/200 12.59 ms 17.64 ms +40.1%
sort/insertionSort/250 19.82 ms 27.79 ms +40.2%
sort/insertionSort/300 28.73 ms 40.15 ms +39.7%
sort/mergeSort/50 686.6 μs 968.0 μs +41.0%
sort/mergeSort/100 1.954 ms 2.222 ms +13.7%
sort/mergeSort/150 2.970 ms 3.589 ms +20.8%
sort/mergeSort/200 3.582 ms 5.030 ms +40.4%
sort/mergeSort/250 4.692 ms 6.640 ms +41.5%
sort/mergeSort/300 5.691 ms 8.049 ms +41.4%
sort/quickSort/50 1.946 ms 2.691 ms +38.3%
sort/quickSort/100 7.801 ms 7.079 ms -9.3%
sort/quickSort/150 17.61 ms 25.23 ms +43.3%
sort/quickSort/200 31.22 ms 43.28 ms +38.6%
sort/quickSort/250 48.72 ms 49.13 ms +0.8%
sort/quickSort/300 71.16 ms 98.32 ms +38.2%
sum/compiled-from-Haskell/sum-right-builtin/100 94.12 μs 128.3 μs +36.3%
sum/compiled-from-Haskell/sum-right-builtin/500 496.9 μs 573.7 μs +15.5%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.077 ms 1.045 ms -3.0%
sum/compiled-from-Haskell/sum-right-builtin/2500 3.293 ms 3.202 ms -2.8%
sum/compiled-from-Haskell/sum-right-builtin/5000 7.009 ms 10.05 ms +43.4%
sum/compiled-from-Haskell/sum-right-Scott/100 63.49 μs 86.57 μs +36.4%
sum/compiled-from-Haskell/sum-right-Scott/500 335.1 μs 456.2 μs +36.1%
sum/compiled-from-Haskell/sum-right-Scott/1000 720.4 μs 986.0 μs +36.9%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.422 ms 3.323 ms +37.2%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.426 ms 7.414 ms +36.6%
sum/compiled-from-Haskell/sum-right-data/100 249.1 μs 351.9 μs +41.3%
sum/compiled-from-Haskell/sum-right-data/500 1.364 ms 1.923 ms +41.0%
sum/compiled-from-Haskell/sum-right-data/1000 3.092 ms 4.322 ms +39.8%
sum/compiled-from-Haskell/sum-right-data/2500 8.307 ms 11.72 ms +41.1%
sum/compiled-from-Haskell/sum-right-data/5000 17.38 ms 24.35 ms +40.1%
sum/compiled-from-Haskell/sum-left-builtin/100 92.11 μs 128.1 μs +39.1%
sum/compiled-from-Haskell/sum-left-builtin/500 483.0 μs 558.7 μs +15.7%
sum/compiled-from-Haskell/sum-left-builtin/1000 1.040 ms 1.414 ms +36.0%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.142 ms 2.967 ms -5.6%
sum/compiled-from-Haskell/sum-left-builtin/5000 9.702 ms 6.828 ms -29.6%
sum/compiled-from-Haskell/sum-left-Scott/100 86.39 μs 59.18 μs -31.5%
sum/compiled-from-Haskell/sum-left-Scott/500 451.7 μs 311.8 μs -31.0%
sum/compiled-from-Haskell/sum-left-Scott/1000 976.3 μs 673.9 μs -31.0%
sum/compiled-from-Haskell/sum-left-Scott/2500 3.136 ms 2.180 ms -30.5%
sum/compiled-from-Haskell/sum-left-Scott/5000 7.214 ms 5.034 ms -30.2%
sum/compiled-from-Haskell/sum-left-data/100 353.3 μs 248.0 μs -29.8%
sum/compiled-from-Haskell/sum-left-data/500 1.928 ms 1.360 ms -29.5%
sum/compiled-from-Haskell/sum-left-data/1000 4.329 ms 3.052 ms -29.5%
sum/compiled-from-Haskell/sum-left-data/2500 11.63 ms 8.222 ms -29.3%
sum/compiled-from-Haskell/sum-left-data/5000 24.40 ms 17.24 ms -29.3%
sum/hand-written-PLC/sum-right-builtin/100 127.3 μs 89.55 μs -29.7%
sum/hand-written-PLC/sum-right-builtin/500 657.2 μs 453.1 μs -31.1%
sum/hand-written-PLC/sum-right-builtin/1000 1.363 ms 940.9 μs -31.0%
sum/hand-written-PLC/sum-right-builtin/2500 3.783 ms 2.633 ms -30.4%
sum/hand-written-PLC/sum-right-builtin/5000 7.972 ms 5.502 ms -31.0%
sum/hand-written-PLC/sum-right-Scott/100 73.25 μs 49.19 μs -32.8%
sum/hand-written-PLC/sum-right-Scott/500 378.9 μs 252.2 μs -33.4%
sum/hand-written-PLC/sum-right-Scott/1000 790.4 μs 530.6 μs -32.9%
sum/hand-written-PLC/sum-right-Scott/2500 2.405 ms 1.630 ms -32.2%
sum/hand-written-PLC/sum-right-Scott/5000 5.696 ms 3.868 ms -32.1%
sum/hand-written-PLC/sum-left-builtin/100 132.1 μs 94.21 μs -28.7%
sum/hand-written-PLC/sum-left-builtin/500 637.6 μs 460.7 μs -27.7%
sum/hand-written-PLC/sum-left-builtin/1000 1.269 ms 922.1 μs -27.3%
sum/hand-written-PLC/sum-left-builtin/2500 3.164 ms 2.293 ms -27.5%
sum/hand-written-PLC/sum-left-builtin/5000 4.300 ms 4.570 ms +6.3%
sum/hand-written-PLC/sum-left-Scott/100 56.69 μs 55.71 μs -1.7%
sum/hand-written-PLC/sum-left-Scott/500 283.3 μs 277.5 μs -2.0%
sum/hand-written-PLC/sum-left-Scott/1000 570.6 μs 569.1 μs -0.3%
sum/hand-written-PLC/sum-left-Scott/2500 1.608 ms 1.587 ms -1.3%
sum/hand-written-PLC/sum-left-Scott/5000 3.534 ms 3.493 ms -1.2%
24e3cfc 74b1b77 Change
TOTAL 436.3 ms 513.3 ms +17.6%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Builtins No Changelog Required Add this to skip the Changelog Check Performance
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants