From 1e59539a94dc3c0bebfc049fd1c51dfa94f6add3 Mon Sep 17 00:00:00 2001 From: Ev Haus Date: Thu, 16 Nov 2023 19:05:16 -0800 Subject: [PATCH] Add note about lack of Windows support & show results on main README --- README.md | 5 +++++ results.png | Bin 0 -> 13783 bytes 2 files changed, 5 insertions(+) create mode 100644 results.png diff --git a/README.md b/README.md index be1356c..d31f714 100644 --- a/README.md +++ b/README.md @@ -5,6 +5,8 @@ This repo is setup to test the performance of various test runners. Specially to - Help the **Jest** team with https://github.com/facebook/jest/issues/6694. - Help the **Vitest** team with https://github.com/vitest-dev/vitest/issues/229 & https://github.com/vitest-dev/vitest/issues/579 +![](results.png?raw=true) + ## Setup 1. Install `hyperfine` via [these instructions](https://github.com/sharkdp/hyperfine#installation): @@ -19,6 +21,9 @@ Then you can run benchmarks via: hyperfine --warmup 1 'yarn workspace jasmine test' 'yarn workspace jest test' 'yarn workspace vitest test --experimentalVmThreads' 'yarn workspace vitest test --isolate=false' 'yarn workspace bun test' ``` +> *Note* +> These benchmarks are supported on MacOS and Linux. Windows is not supported at this time. + ## Suites - `jasmine`: This is our baseline, using Jasmine and happy-dom. diff --git a/results.png b/results.png new file mode 100644 index 0000000000000000000000000000000000000000..7dea0a59b87825305bcffb852f8c9e55ebeb0f26 GIT binary patch literal 13783 zcmeHuXH?U{w=Id0A|gcukuC(3E>)B!NS7i4h8{&gx`2Yz1OXdWN|25sDn0ZPN)Q{; z1SE8@P^C(h{^kehzpQoNw|n1u_uenC43n8NGw1BR&pG2GeO+~$LnjWAk&)48YFsoR zBZH&J$YA#=$-yVDs&+WQFPMjcx-waQE88R)85f!6#S4aaEoTO;oY>U|cYaM;gc$~i zyFEVHNjXk+k6OdR>D@=wpQ?gf2Djo2nVwuQe_Fzn{yOC4lOKFYt&^{^k3KtP5TJF! zJ@6(Y;}Z=&<;_V|!N5$pB74dw=_Pvi3@TNT`Ba8)y|yOLZ@zE4>oM&?8ro`Y?p>{{ z$E-Aatw<%UH#ASD`YLSBH_+0EBIuOJV9<}iH;7qo^f6ma6-q8F865n;9^*p0aqs_w z41SQB4u6O|Q})j{u-JD}djr8}Mj<7l!136zKeNH$Ox?SaKtJ^HWUw5xexl0WN-zW^ z%KX5eRg~)Ch}?S@?2qhP0e*l*Y5sRnrT-4cE8-HEkifFIT!0z$TZl=MRNVYVtD~(Q zYWjedL+)n4N^x33+V;|`vCg#Z5>t!Qj0@F9da>7mXDIOkr_dmO{@UduXU9=~-KQ1= z&%Cp8)xX}ejxpE$4p|#ot-WfvdawMb_)R+eJz7O}$cw)K$8z{G$}Au*r%|!q*IjGN zf!TB`b{(!=IA37+Oe3S(f)71_DM}4!>S%i6Z7}AjP!7 zm#RBcOq-j;zyphcjUnMyTR*R^$XjhM#J4nw);ZPTY)Yovt`=CP~%zf5P9WAasV$<{YojF^gw%3{-< z<$yGKy&XS?Wq#HpTiE6H$bc_l;o-d=?ptvM78S9zYjutzH6~Yf2F!`;zdtCt1Z+)N z^_QhIU3U)coWtyFthp_3OtyB@XqDxWNX8pEid&OuJa0)kMuJ&>tFW_XJs%C|?DFKzx0O4sTf5B#cW*dE&rOwY}b5*N66)A_<=tT%Im&>%;S4=8xQ^M2F{YE#$e=oWG|z zJ9yM1dK7>6van&8?6Qz=oX)yqHdzzuvzdtwTeSp&?*(*YYGhK}FFS80YScEL*NzT1$!R_& zd{et6cdhtdKFy5IZ=I#Ks4EwMpXCBLdn6M44vsVX>Hg{`4n7!$+u4|oz8nT~EL>b0 z6~$C?v2~s3Gxf!9+FbIEMC49u+xpfnrpyVk;D2_x@}euh#?!d=Vn^R3vuc~T-0?ak z&44eu@QLO3c#WaH^K*=J@*xN}AA^M$Nn+uoqXW?@v6;esT253C1kNqDUNc>yQ6DbL=tT5E)0alHET6mvu$pfEU14O zjzP}F$txCJ_Aew*IttU<%9Przvgh$)o%_r3#yEs9b+L8TKF1eb|F&jit4%tVF&>c zaLYy1#NikojGqPemKXE7*8^eC@n`**A8*>PZ@4=g%$*M4NH`On*h`>{mk2@ziuRA2 zdT~h?Q8W!+1EE~Gc3x!A+ivc4&Yf3jh)5@FTvXpji{RM{8Ko;|sdGW#$O)aDgN>7} z53K~yHZmiGxv4?fz8gE{XW0QPq)P%=urHAe+b1t0z=1}0Mr2+0S?`n%7Hf1umhb+8m6?6#OC8(cT7TQFY@?NpsqTWLL4sFOf4S@M^7)Yb z%kV#E1SmcZ`%^|%R@T0ut35*^yF>E#>S>s2L}gj7spx_ty~AI zN=Gc)<@V1k79fGZmG0v_#a9`M26E$ew$9I0TOVORcVlIC(2-PN0 z{ow_P;hXPVjoln$EOVs&DQ~h}D_&!j4#TDjKX6D;9AU%viB`|wo1B}I0daDMhll57 zd3kq$sHllnY`mGV-|C=OOG}bWOPt`S%^*Wu3&kiLFRe^O(ek&$8Rc`al9?*(IYB2(^aYciw40BxhlNNh69r;p-tURu&&*ut z$)xTa4PrL`+qwPklLaONMU#wXi`e%f$}a#Zx{iKd-A4+nk}jA_SL}%T9#X&%KY>U7 zr26H%Z>bX3D>9fM|M3U=&_f1a23WEj{9AtiNVuY|V6kyW!y5iB=>wMZQQq8jN3y_= z2e)5&m1@!MI9}(w%D$Fv=iO*`%y>qXnBDi#qjuK}9sVd~;yKKAb;8r9V&Gn1W@g%$ zSaWf*318E>*MFae71wp2lthU#?f3%mAn*g;K-2*orV4lE7a(uU>r!@LyXPUHj4B-`|oT zVb}b#D`z~?OEJ`&DU>DGJ^zlW>h5w%I$Sr1(PF&ZQ%jSbFH1|ieoGjAh~z9MFUlR? zF%OUy7r*Y~>#Kvo)csOPKx6^Ym>}=F(qp4!zcWzjAswrur&oOOwWrZ#%3X&Ed`umD z7*$+c>}jj19NVm<*%QqoxOyiKi@Y#7|E*!{;}ag~*hcN4?)LU;9R5p}`%|kG39_m3 zsAF}XW&QW=Me?9Bxsa@0LJH)g-rpbbHwPY|XkKhnbPbBB^P6ZxTh#d6384Dyb>hT{ zqGz8%q|5y#0%{G3(JK!gJaG0%Nl6*298Z+aGi3|so zDTJsL#Ceu~|A-f^r_N9hCe1HHca{cC&S+F?y9AU$M}2&}FbH z(=z7Xt|z=ZR8m?x>LPZV7=5JM=Wq}we&EuVL@CGV`**$9yy&ZJl-4RS%+LIG-cXD7 zw9Jcq43CV=5nUT)XT(u1K6cy3>L*lh>F_6csD{|##`E0i`#E3kB`mg7yiR;bhbW*D zC%xx2`ixxY)7NECkFi}`j1Rc~B$nX-Y)`~}Kl>*L(l3B03DRe~|0j$j1%P5OeEj22 z;u%N|0Fy@9?f8CF3<&GL9Y3(%*5trs4L2?h;~j^TFko&nSPRzZqOkBuI1VRyXaDQz zFO@PRPzWIruKfjH2P;W0X`s$|FT9Xnt*up%ICsv$)YNo(b;0diLqmhtmIy0;Q@XFe ze`cKZ6NNk>lH{fs(hJc84 zzuI&^(KM9`hc1DQYi;0yQ+DQUxua;^aX*TjD~4?vl6Te~xQFe)I-Y4#{mXPwG^hgy z4oE3Jls&IKN|7IL>C<>fgScQd+mK>Gx9Hd?ghOP{^p_{4rgChQIi00$)FK|r(sSP1 z83XgjRsqeAPohRG?b=eMSY=$Q9X;&}vB()3;8T;6_B`C#d3h~<->9wd-g^PNIJf>o zAk^v9PC(my17Q12?-iE7cL1KvSs_>Z4siG_MbxZJCKz`5L0pV7S)c$ImMz(r>?i>K zXsGr$;3RPQP)a~Kl5`LCu-Hs7zL=Pp6sZoo3))=I8N~v$N97qLz{j6}%daQ(xqTLTvK;^rbv0n z)yF^`r6&L*TO<>cwTr>hS{#~GhBB^0l6vyXUo7Hy{n*dl{y05I=+3pO8zL8#O*P4l zrU)6MzbOuaFox#Tt4>B>Ji`Mw7Z;aClhag&{JP0ct;CxHtgd%MP?V^F#dci`YRr-h z2OEF;>^5xb+XK$BG`{VXepk_+ptzL6XqG(d4-pAl8>?+|?E;0qU?g1UBnau~K=VfX zTQCsT#c>-E9 zN@o^HOWwls`2{!yKK35DSI5NAHu03B8};=UB;@6t+t4>}-VBh{!>#J3%GqOvy1VVv z)OXeHlQhhHJ;j*S&U!oxC#MVutQEVW!*@qN9oyKN?0hw|!cu;*!ed-l0x;Ta&8p?% z&zyojpKUjTADe57YO~+lNKGn)0c$E$Q=H?xe{c8{L&XTv>)5)4x!lWV7xa&)kOdMT z_haOX#&!)2xu~?Q%=82Hi~QBl-P{~D7&-kQJ0jvp=kTzrN+*zZ&46^n993qC@%qRD zpm}?w2MZS@nDGN{3x_qcYCLC5S(`%n(8$nE34=wPM<%qZcv`9Z;e| zB$|V}9yu`ZaZ;55FAelp7Vac@v`nC4?l(9K;){4m`6YnbrPstRk^dK7NMumYfV^M zxq0lds5H&r(L^M7Q;m6#z&W5Gg-u+Rti;drT@z(RG#%%I8?$7WJOY7n3J?fmp|$Wa zO(Fw_$vuxihb;B8AGc4Lh{qzUA;|nxHA)b-#g{yYz-9{T$^&#vM+5h+Pd_cqe3=+c zGYe#`C(Gwyv*q=v0-#VIt;wUrlSWr=uqy^s&tu~TgGMRN^$J<70Cy}Cn}O6B5>!gH z$aSBsX~1zpHEY_z49NjY8JxWdroLiIho^+j0V#)o!pP4EB| z!UvPVLYsJS1WKtD=}hsye}@L31zHG;1}x5SV*wsjMFxDXfw> z7f z3eFiP_+bMYr~zE>$zjBx5)purn=F*+J_1Mb@222*KCffCMaG>k3`=axc!7|dpu2e4 ze5x;QO1MpMgC)p&C~3VAk^4nGYMTeEbPaBbd2wh8f95{c=!I>Sv%LjDkP5Z%Wff!% z`?QP;*&>;__R>b+zA|l$b1>j>Qg5rN01#bPnu;`h;)%#TDb?w$J=NF3iubz=>VMtL z@{ry(=1pH#cTi1fu1@$ncPZQ$Tzi^L)va&$RQ-Q{d(c88Vz;Ua3ffw)x3sh*fGBwi zQBGQ#yf0~KX{o0`)T&kv2+>JB8?9`X+RE0Dj8Gk~p(Y`cnZyd)bd8m6{2nTUuND5|C7v#Sb8_ zY1`%wbeF<$h|Gouv`J9)OrKBG+e%&if%j6oy0h;>fPE*XkV0_KF*X$(cF4h!ZH;4^ zmxuxe5`$$W`GfCP(2dhy!dYdSkLt-?JHmDror>A^W=-B4Rl$%?0lmJcjjdh({5guo zNTj54RAqHB6OJoUl#_Exnwp-LY?EJ2_FkWSHIo}(y@}Kae`5PcUnSuLC0A7NuH9!K zBHp!|fFeeJ<&iLmRNStp^qlG2Z0@`c%OM>mU0?550U0L?D{Juvz9Lj?aBA05)m=*) zwf|u$oRo6jYdSSME9*3Yd(c_IN(lX^vY-%Sxa%R+e{aU(=NXz(j)t!k zLNZ57ZCg$dxGgQWErMNG^aEyxRZk7q&A*}cl&Ge5|MBC;PwfEjf+LXdRrTA^(tu-)B*T7 z(YioroM8UE&eL@_@+W8GVPpRc0k&s%X7WcaWEdT%*kPkW8L_&xGQ$u|$G|9~5jr~j z<1d%Wh4UQav0cBVl!*=lk9h#AH}0K@1~`+LGP+Z`K&B)kg}HZ?h)@m8Z=r#I`SE2c zpoBp!b0YR4S>RcqntgsK6FZ7u8XOPgh2wTcjITvgL^L*GNNUFwvQJ`_B!FUBQj5W6 z+UaD9!P_Z>R-384fA_o(XPpUZ9C7rnq{TSd+f!wz8zJa!3c%pFp<4|2rQ96-M$C}0 z&^W6<@smP*m;c$3=H_M#PDU1Lfh~X)lDiA5frayxk#Lf@T5npt&rE5z6ZOJVztu|h zZGJb=4DX?P0HvA%hAfGY!*Qunac?LuDh45iW}mFh%*-rqif3Wi#DlH-ze;FcsMk)8?Hm&*6XT@S%P4-$MDMwoV6)wGt#{L;!wUmNw3 z>!lc4f1D-*mBGSVkZ8?P^h^YTTgLmlLXdtfW~J9|X4o@9|Ci$7KG)7I-98p}cBvxT zB;*@%^Uch8+W=kzr?-cPhx2S^3! zo26xCeb`ZW9O8`PYk82!dCe4iI=l21*XvIuKZN)y1kQAvk3dArnKH@;^@6-goKF#+wtQSIa3{D zttsaLqR?b3E{`+J{{H>@9ppt) zsApa5bQ&%mgle9aa4AKTYYg(uJ+&{GOF>D-w>!gU6HqP=h3V0fL1ge_pe{Q}BM0ul zG{ayeLa|)#Y0c?8l0|S4+o>Fb1$QsjPu-!VCa&ay=g<7;d!o-Td%e*7a>~zt??GTH^{0vpe0&N+VHfvZos|N$+j3W2T4O_- z%W$o;v~%ALpdamw^GxFku0^Pk1uBDeLd2xMP{MM!`HpCzxEir>&sPTqlA$uL_m6Oy z=~s`niSCM1AOis@M_FBbLAlFd;`h@Xc8F-GK1Rd6zgtR_)+|VL#@;?UT9%kp|Ecw6 z;~9{%++fnSzjP`{$ry4L9mrX-7}dBQ0lD=cuI~rSiyid{wnB+33`OQd_h(ZR?HOtc zdS^ELpK9OBrZl_?o%aeN_j;b*phtEOIkSBpsiHCbW>J@_v0X*~4(1y;<5Gn$g(SP9 z+2$rqLMMw27JNYOk7*hhfNBgQ6=TO=9Tu@LAjfG5%}uj^ZW{-!kd0b_a*z(9;1W#4S^Wv;_6K0ZEU z!@^gh7sw1ud_uj;)NNmI_)KsUylY6Qf+pfO9*K>s)_2DG_Aum1vW*9tzl) zA#5Wx&u;d7P$=8YZr*KEJRs416jUO95-i*N0kVzqoaI&&+!$ya78aH>H8nLa>*|IT zP7TboB_<@8;1_tW<$$UNNBo=NrD`7BMPhV}mVX8zS;dn)^n>I`jkzpGpgREk(e?Gb zqxi?A5lD2SiOtn`^C;7Dmz0#O>}C8daL(N-4SAYy4mLJPNP8#flPgT$CCT5)lfNZ0O7g5WWV@Hu;3}s_7kq=O%e|6qVz8Vn6IVQe?=ka zD8cqS7WvV~9ND#rpJwab`+Y~$q`cR-KVeP~LFxo8#;|Ory(RKy-R>hjs3e3!k;)4` zH~qkX2h`mw-|6D5-`WG@{+k|u59!BqY8mI}-M ziF7wMIAtskps^37#yPwDJcN3eYEqSlq{j!Bv&^2nv?~5=oYGJQI*3+ifC@z}W2&}E z?%gd?G!<%DFN6o$aU5W5c>2f5^G5ifF`@460em7y4ea*soqA5|^({Xa6 zMjXBKkM#VWpC;YRaZ7N+QN92i+QG{IhiN(Sn>w?~yydqQR(h<*%!b#ETOP!PTzdh* zQV_IR#(%)l0%zw}MO!Nc!l@8i-y;&a5WbCqR0Ee$R=o;-jlU;!&_7f_cO}+G(>_Q} zP1XJ0klIwpPJFN`M<-WXYm`m>Fu=kU&4QNS`bA>#WT0C~gtSQh z!Tqtk;8^YhpsZAS{a7guy5eI;`PZhV{r0=|F!7zi9WWh;dcGaS_@GSWUO-uG?5 z@pI6);$4*!`xhXEFfkiI;M59IUHIWn9CqL%`OsIK+1Y~gKbePf-tO<}5 zUFC;gO+2i3B{5G!?`Km==0Hbth+d|}u%|aJL2@MX~9}MO`?gfnvhW2)Wdv9-` z=MZ)toH&;X0wuj0xvP<{ZF=}DSHfBEX#K-Ob2I6Xw9 za9*({=MFWK{!AU8Z5VJAu3pqpMDF|Kvxi{LfMCkbF4KJk;^R|b zX@^R0P^m$^`JCM&G4Ne}fX!OBK2Nyc0sQ{hT8C)xRvK9LNvH5n5hMLF@S_ZagKX+V z0kXnhd?5cfbGwlUERy_?XIlVXk#t?OYsh*?oT=60r}%|=KP=|VOycdHGwa`WQMj}1 z(YU;^SEvyIA3|js^R&`)10>Q*qsQlvkT<{0v_}{V5D$~I4ti9lvE;I$1Qlaha^qM# zln1~v6(1f98G$l*=3N+6bM6hwe5_N*1^&P_&8V7w23TjU8^Wea6bLSCS9@9ybuA45 z`)8hWUm`F7D0p{`541of{`qTNOcNZ59U_(AePZ|thhdKI!op=hb7UYJ%ac$qK=y?1 zIaC{$m%E*R3QT`Fdb$6b=InC#W4U|$mCRY1W|WMeZ6(keje~0FlQc&FiJ1z}<8Rkw z-B-#0mZ@c)6|skieV!hqSX8JglA#J$B)F|erVo4&=&+uH*bt`Oo#;S00&rlo{d><1 zNHwTH`7S^t(sE1m|>?Z5%5QAbf9d)D- z3qa~E+;np)f|SNH9)N2{@wfAUO&nks9KsPgP}(PR8*(~0E?=sP?jz6^pEBMRHbSg> zA5`k?fWRw#c>?YYyurKVth5QViO>HnH(^Zm!Llx3aC)ewf1uXC->I*pak{^}E!VU( zJ6NmBB^sR6_P?K$(R`tYhsPLb`Mo3%`kjWVy|<@;0An(LGzPAx8{E^sUd1uL+-A#v z?)F{M)lCd#78MUQ!WVyy!lVW_6}(6$Hlqb46vM3{lYr%c9t*(ny`NB3S~MU`PU(_AelfvAN?aBBy{ew_wwKBynDCmpAxQc?=9$N0*h z3D|qzrE~(gDE7x&>l5(rSN0xB1Tp|OMt+y>kfc4~eDRSrNSHuNS3?`PEa`5$*4&!TUpDIO>ar)SX;31`1u8+K)Kc;Gc0M>ntX;?#9R!#f3BYDVGN&?fK$E&k^k7s zX@Ui=Nv&}!8v6qt=O?UaCWMBb1_+y#^?=t4+O?dltPk5B7h8r3FWT6(6jc{_Y2ywL7TFyAGmfxR0aKkxF=(Bd(SJBlym_4s_Ag=Pxcymg)G3+ z;tll$!3@|$03YFr%KMY)9|M?eq?WjNanDwm6oBFrQXzZsq?8W5Z^#al9EbXhknIit z^Q9aP?Z5C*G6Dc@#A4riba$iwyYc_M@&8&^|GERKs=liyqO&{<{-+k1rmF76d}Z{# F{{vyz>%jm3 literal 0 HcmV?d00001