-
Notifications
You must be signed in to change notification settings - Fork 477
chore(ci_visibility): code coverage upload for pytest plugin v2 #16282
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
cd0bc6b to
1d55081
Compare
Codeowners resolved as |
Performance SLOsComparing candidate gnufede/SDTEST-3005-4 (471eaa8) with baseline main (1e7e0c4) 📈 Performance Regressions (3 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 111.087µs (SLO: <130.000µs 📉 -14.5%) vs baseline: +3.4% Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ add_inplace_aspectTime: ✅ 105.946µs (SLO: <130.000µs 📉 -18.5%) vs baseline: -1.1% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.0% ✅ add_inplace_noaspectTime: ✅ 28.362µs (SLO: <40.000µs 📉 -29.1%) vs baseline: +0.5% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.6% ✅ add_noaspectTime: ✅ 49.191µs (SLO: <70.000µs 📉 -29.7%) vs baseline: +1.2% Memory: ✅ 43.018MB (SLO: <46.000MB -6.5%) vs baseline: +5.0% ✅ bytearray_aspectTime: ✅ 256.673µs (SLO: <400.000µs 📉 -35.8%) vs baseline: +1.1% Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +4.9% ✅ bytearray_extend_aspectTime: ✅ 644.024µs (SLO: <800.000µs 📉 -19.5%) vs baseline: +0.7% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ bytearray_extend_noaspectTime: ✅ 269.455µs (SLO: <400.000µs 📉 -32.6%) vs baseline: ~same Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ bytearray_noaspectTime: ✅ 141.985µs (SLO: <300.000µs 📉 -52.7%) vs baseline: +2.4% Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.0% ✅ bytes_aspectTime: ✅ 217.157µs (SLO: <300.000µs 📉 -27.6%) vs baseline: -0.7% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ bytes_noaspectTime: ✅ 133.052µs (SLO: <200.000µs 📉 -33.5%) vs baseline: ~same Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.7% ✅ bytesio_aspectTime: ✅ 3.891ms (SLO: <5.000ms 📉 -22.2%) vs baseline: -0.7% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ bytesio_noaspectTime: ✅ 315.200µs (SLO: <420.000µs 📉 -25.0%) vs baseline: +0.3% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ capitalize_aspectTime: ✅ 89.057µs (SLO: <300.000µs 📉 -70.3%) vs baseline: +0.6% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.6% ✅ capitalize_noaspectTime: ✅ 251.324µs (SLO: <300.000µs 📉 -16.2%) vs baseline: ~same Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +4.8% ✅ casefold_aspectTime: ✅ 92.388µs (SLO: <500.000µs 📉 -81.5%) vs baseline: +3.9% Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.6% ✅ casefold_noaspectTime: ✅ 315.529µs (SLO: <500.000µs 📉 -36.9%) vs baseline: +0.8% Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +4.8% ✅ decode_aspectTime: ✅ 87.913µs (SLO: <100.000µs 📉 -12.1%) vs baseline: +0.2% Memory: ✅ 43.018MB (SLO: <46.000MB -6.5%) vs baseline: +4.8% ✅ decode_noaspectTime: ✅ 152.862µs (SLO: <210.000µs 📉 -27.2%) vs baseline: +1.6% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.0% ✅ encode_aspectTime: ✅ 85.647µs (SLO: <200.000µs 📉 -57.2%) vs baseline: ~same Memory: ✅ 43.037MB (SLO: <46.000MB -6.4%) vs baseline: +5.1% ✅ encode_noaspectTime: ✅ 137.890µs (SLO: <200.000µs 📉 -31.1%) vs baseline: -0.3% Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.8% ✅ format_aspectTime: ✅ 14.665ms (SLO: <19.200ms 📉 -23.6%) vs baseline: -0.2% Memory: ✅ 43.195MB (SLO: <46.000MB -6.1%) vs baseline: +4.9% ✅ format_map_aspectTime: ✅ 16.694ms (SLO: <21.500ms 📉 -22.4%) vs baseline: +0.9% Memory: ✅ 43.214MB (SLO: <46.000MB -6.1%) vs baseline: +5.0% ✅ format_map_noaspectTime: ✅ 373.437µs (SLO: <500.000µs 📉 -25.3%) vs baseline: +0.9% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.0% ✅ format_noaspectTime: ✅ 310.383µs (SLO: <500.000µs 📉 -37.9%) vs baseline: +0.2% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ index_aspectTime: ✅ 125.851µs (SLO: <300.000µs 📉 -58.0%) vs baseline: +0.7% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ index_noaspectTime: ✅ 40.528µs (SLO: <300.000µs 📉 -86.5%) vs baseline: +0.2% Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +4.9% ✅ join_aspectTime: ✅ 214.404µs (SLO: <300.000µs 📉 -28.5%) vs baseline: ~same Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +5.0% ✅ join_noaspectTime: ✅ 143.247µs (SLO: <300.000µs 📉 -52.3%) vs baseline: +1.1% Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +4.9% ✅ ljust_aspectTime: ✅ 502.768µs (SLO: <700.000µs 📉 -28.2%) vs baseline: -1.0% Memory: ✅ 43.037MB (SLO: <46.000MB -6.4%) vs baseline: +5.1% ✅ ljust_noaspectTime: ✅ 264.819µs (SLO: <300.000µs 📉 -11.7%) vs baseline: +0.7% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ lower_aspectTime: ✅ 298.923µs (SLO: <500.000µs 📉 -40.2%) vs baseline: +0.2% Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +4.9% ✅ lower_noaspectTime: ✅ 236.287µs (SLO: <300.000µs 📉 -21.2%) vs baseline: -0.4% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ lstrip_aspectTime: ✅ 0.330ms (SLO: <3.000ms 📉 -89.0%) vs baseline: 📈 +22.8% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) ✅ lstrip_noaspectTime: ✅ 0.175ms (SLO: <3.000ms 📉 -94.2%) vs baseline: -0.7% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ modulo_aspectTime: ✅ 14.434ms (SLO: <18.750ms 📉 -23.0%) vs baseline: +0.4% Memory: ✅ 43.234MB (SLO: <46.000MB -6.0%) vs baseline: +5.0% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 14.885ms (SLO: <19.350ms 📉 -23.1%) vs baseline: -0.3% Memory: ✅ 43.136MB (SLO: <46.000MB -6.2%) vs baseline: +4.9% ✅ modulo_aspect_for_bytesTime: ✅ 14.423ms (SLO: <18.900ms 📉 -23.7%) vs baseline: -0.2% Memory: ✅ 43.057MB (SLO: <46.000MB -6.4%) vs baseline: +4.9% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 14.709ms (SLO: <19.150ms 📉 -23.2%) vs baseline: ~same Memory: ✅ 43.155MB (SLO: <46.000MB -6.2%) vs baseline: +5.0% ✅ modulo_noaspectTime: ✅ 0.371ms (SLO: <3.000ms 📉 -87.6%) vs baseline: -1.0% Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ replace_aspectTime: ✅ 19.021ms (SLO: <24.000ms 📉 -20.7%) vs baseline: +2.9% Memory: ✅ 43.116MB (SLO: <46.000MB -6.3%) vs baseline: +5.0% ✅ replace_noaspectTime: ✅ 283.866µs (SLO: <300.000µs -5.4%) vs baseline: +0.6% Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.0% ✅ repr_aspectTime: ✅ 312.127µs (SLO: <420.000µs 📉 -25.7%) vs baseline: +1.2% Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.9% ✅ repr_noaspectTime: ✅ 46.874µs (SLO: <90.000µs 📉 -47.9%) vs baseline: +0.4% Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.1% ✅ rstrip_aspectTime: ✅ 383.493µs (SLO: <500.000µs 📉 -23.3%) vs baseline: +0.5% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ rstrip_noaspectTime: ✅ 183.901µs (SLO: <300.000µs 📉 -38.7%) vs baseline: +0.2% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ slice_aspectTime: ✅ 185.674µs (SLO: <300.000µs 📉 -38.1%) vs baseline: -0.1% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ slice_noaspectTime: ✅ 53.879µs (SLO: <90.000µs 📉 -40.1%) vs baseline: -0.6% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.7% ✅ stringio_aspectTime: ✅ 3.953ms (SLO: <5.000ms 📉 -20.9%) vs baseline: +0.5% Memory: ✅ 43.037MB (SLO: <46.000MB -6.4%) vs baseline: +5.1% ✅ stringio_noaspectTime: ✅ 344.702µs (SLO: <500.000µs 📉 -31.1%) vs baseline: -0.7% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.7% ✅ strip_aspectTime: ✅ 268.204µs (SLO: <350.000µs 📉 -23.4%) vs baseline: -0.3% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ strip_noaspectTime: ✅ 176.977µs (SLO: <240.000µs 📉 -26.3%) vs baseline: ~same Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ swapcase_aspectTime: ✅ 341.499µs (SLO: <500.000µs 📉 -31.7%) vs baseline: +0.3% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +5.0% ✅ swapcase_noaspectTime: ✅ 274.587µs (SLO: <400.000µs 📉 -31.4%) vs baseline: +0.4% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.0% ✅ title_aspectTime: ✅ 328.311µs (SLO: <500.000µs 📉 -34.3%) vs baseline: ~same Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ title_noaspectTime: ✅ 268.305µs (SLO: <400.000µs 📉 -32.9%) vs baseline: +2.7% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ translate_aspectTime: ✅ 496.331µs (SLO: <700.000µs 📉 -29.1%) vs baseline: +0.6% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.6% ✅ translate_noaspectTime: ✅ 425.344µs (SLO: <500.000µs 📉 -14.9%) vs baseline: -1.4% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ upper_aspectTime: ✅ 304.326µs (SLO: <500.000µs 📉 -39.1%) vs baseline: +0.2% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.6% ✅ upper_noaspectTime: ✅ 231.995µs (SLO: <400.000µs 📉 -42.0%) vs baseline: -0.5% Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.0% 📈 iastaspectsospath - 23/23✅ ospathbasename_aspectTime: ✅ 496.616µs (SLO: <700.000µs 📉 -29.1%) vs baseline: 📈 +18.1% Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ ospathbasename_noaspectTime: ✅ 430.524µs (SLO: <700.000µs 📉 -38.5%) vs baseline: +0.1% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ ospathjoin_aspectTime: ✅ 628.607µs (SLO: <700.000µs 📉 -10.2%) vs baseline: +0.4% Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.7% ✅ ospathjoin_noaspectTime: ✅ 638.583µs (SLO: <700.000µs -8.8%) vs baseline: +0.6% ✅ ospathnormcase_aspectTime: ✅ 348.615µs (SLO: <700.000µs 📉 -50.2%) vs baseline: -0.3% Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ ospathnormcase_noaspectTime: ✅ 354.642µs (SLO: <700.000µs 📉 -49.3%) vs baseline: -0.3% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.7% ✅ ospathsplit_aspectTime: ✅ 492.549µs (SLO: <700.000µs 📉 -29.6%) vs baseline: -0.3% Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ ospathsplit_noaspectTime: ✅ 502.732µs (SLO: <700.000µs 📉 -28.2%) vs baseline: -0.8% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ ospathsplitdrive_aspectTime: ✅ 374.868µs (SLO: <700.000µs 📉 -46.4%) vs baseline: -0.6% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.6% ✅ ospathsplitdrive_noaspectTime: ✅ 72.291µs (SLO: <700.000µs 📉 -89.7%) vs baseline: -1.0% Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ ospathsplitext_aspectTime: ✅ 457.594µs (SLO: <700.000µs 📉 -34.6%) vs baseline: +0.5% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ ospathsplitext_noaspectTime: ✅ 464.964µs (SLO: <700.000µs 📉 -33.6%) vs baseline: -0.4% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% 📈 telemetryaddmetric - 30/30✅ 1-count-metric-1-timesTime: ✅ 3.372µs (SLO: <20.000µs 📉 -83.1%) vs baseline: 📈 +16.4% Memory: ✅ 35.547MB (SLO: <38.000MB -6.5%) vs baseline: +4.8% ✅ 1-count-metrics-100-timesTime: ✅ 206.291µs (SLO: <220.000µs -6.2%) vs baseline: +0.2% Memory: ✅ 35.507MB (SLO: <38.000MB -6.6%) vs baseline: +4.8% ✅ 1-distribution-metric-1-timesTime: ✅ 3.290µs (SLO: <20.000µs 📉 -83.6%) vs baseline: +0.7% Memory: ✅ 35.507MB (SLO: <38.000MB -6.6%) vs baseline: +5.1% ✅ 1-distribution-metrics-100-timesTime: ✅ 214.316µs (SLO: <230.000µs -6.8%) vs baseline: -0.3% Memory: ✅ 35.507MB (SLO: <38.000MB -6.6%) vs baseline: +5.0% ✅ 1-gauge-metric-1-timesTime: ✅ 2.155µs (SLO: <20.000µs 📉 -89.2%) vs baseline: +0.2% Memory: ✅ 35.586MB (SLO: <38.000MB -6.4%) vs baseline: +5.0% ✅ 1-gauge-metrics-100-timesTime: ✅ 136.871µs (SLO: <150.000µs -8.8%) vs baseline: +0.5% Memory: ✅ 35.488MB (SLO: <38.000MB -6.6%) vs baseline: +4.7% ✅ 1-rate-metric-1-timesTime: ✅ 3.037µs (SLO: <20.000µs 📉 -84.8%) vs baseline: -0.3% Memory: ✅ 35.488MB (SLO: <38.000MB -6.6%) vs baseline: +4.9% ✅ 1-rate-metrics-100-timesTime: ✅ 219.899µs (SLO: <250.000µs 📉 -12.0%) vs baseline: +0.5% Memory: ✅ 35.547MB (SLO: <38.000MB -6.5%) vs baseline: +4.7% ✅ 100-count-metrics-100-timesTime: ✅ 20.902ms (SLO: <22.000ms -5.0%) vs baseline: +0.2% Memory: ✅ 35.527MB (SLO: <38.000MB -6.5%) vs baseline: +4.9% ✅ 100-distribution-metrics-100-timesTime: ✅ 2.240ms (SLO: <2.550ms 📉 -12.2%) vs baseline: +0.7% Memory: ✅ 35.488MB (SLO: <38.000MB -6.6%) vs baseline: +4.8% ✅ 100-gauge-metrics-100-timesTime: ✅ 1.407ms (SLO: <1.550ms -9.2%) vs baseline: +0.4% Memory: ✅ 35.527MB (SLO: <38.000MB -6.5%) vs baseline: +5.1% ✅ 100-rate-metrics-100-timesTime: ✅ 2.254ms (SLO: <2.550ms 📉 -11.6%) vs baseline: -0.5% Memory: ✅ 35.488MB (SLO: <38.000MB -6.6%) vs baseline: +5.0% ✅ flush-1-metricTime: ✅ 4.518µs (SLO: <20.000µs 📉 -77.4%) vs baseline: +0.2% Memory: ✅ 35.665MB (SLO: <38.000MB -6.1%) vs baseline: +5.0% ✅ flush-100-metricsTime: ✅ 176.916µs (SLO: <250.000µs 📉 -29.2%) vs baseline: +0.5% Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +4.8% ✅ flush-1000-metricsTime: ✅ 2.180ms (SLO: <2.500ms 📉 -12.8%) vs baseline: -0.4% Memory: ✅ 36.392MB (SLO: <38.750MB -6.1%) vs baseline: +5.0% 🟡 Near SLO Breach (1 suite)🟡 tracer - 6/6✅ largeTime: ✅ 31.881ms (SLO: <32.950ms -3.2%) vs baseline: +0.4% Memory: ✅ 36.726MB (SLO: <39.250MB -6.4%) vs baseline: +4.5% ✅ mediumTime: ✅ 3.138ms (SLO: <3.200ms 🟡 -1.9%) vs baseline: ~same Memory: ✅ 35.173MB (SLO: <38.750MB -9.2%) vs baseline: +4.8% ✅ smallTime: ✅ 364.653µs (SLO: <370.000µs 🟡 -1.4%) vs baseline: +3.8% Memory: ✅ 35.252MB (SLO: <38.750MB -9.0%) vs baseline: +5.3%
|
3902c27 to
471eaa8
Compare
Description
Testing
Risks
Additional Notes