tracing(llama-index): add APM tracing and LLM Observability for llama-index#16537
Conversation
Codeowners resolved as |
Performance SLOsComparing candidate apm-ai-toolkit/new_integration/llama-index/20260214-203912 (486fde2) with baseline dubloom/http-client-events (48e8425) 📈 Performance Regressions (3 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 105.784µs (SLO: <130.000µs 📉 -18.6%) vs baseline: +3.6% Memory: ✅ 44.443MB (SLO: <46.000MB -3.4%) vs baseline: +4.3% ✅ add_inplace_aspectTime: ✅ 102.517µs (SLO: <130.000µs 📉 -21.1%) vs baseline: +0.1% Memory: ✅ 44.481MB (SLO: <46.000MB -3.3%) vs baseline: +4.8% ✅ add_inplace_noaspectTime: ✅ 28.147µs (SLO: <40.000µs 📉 -29.6%) vs baseline: -1.4% Memory: ✅ 44.544MB (SLO: <46.000MB -3.2%) vs baseline: +5.0% ✅ add_noaspectTime: ✅ 48.820µs (SLO: <70.000µs 📉 -30.3%) vs baseline: -0.6% Memory: ✅ 44.563MB (SLO: <46.000MB -3.1%) vs baseline: +5.1% ✅ bytearray_aspectTime: ✅ 254.784µs (SLO: <400.000µs 📉 -36.3%) vs baseline: +0.7% Memory: ✅ 44.711MB (SLO: <46.000MB -2.8%) vs baseline: +5.4% ✅ bytearray_extend_aspectTime: ✅ 635.177µs (SLO: <800.000µs 📉 -20.6%) vs baseline: +0.4% Memory: ✅ 44.598MB (SLO: <46.000MB -3.0%) vs baseline: +5.0% ✅ bytearray_extend_noaspectTime: ✅ 265.635µs (SLO: <400.000µs 📉 -33.6%) vs baseline: +0.8% Memory: ✅ 44.603MB (SLO: <46.000MB -3.0%) vs baseline: +5.3% ✅ bytearray_noaspectTime: ✅ 143.989µs (SLO: <300.000µs 📉 -52.0%) vs baseline: +1.0% Memory: ✅ 44.624MB (SLO: <46.000MB -3.0%) vs baseline: +5.2% ✅ bytes_aspectTime: ✅ 224.881µs (SLO: <300.000µs 📉 -25.0%) vs baseline: +1.5% Memory: ✅ 44.462MB (SLO: <46.000MB -3.3%) vs baseline: +4.7% ✅ bytes_noaspectTime: ✅ 136.083µs (SLO: <200.000µs 📉 -32.0%) vs baseline: -0.4% Memory: ✅ 44.404MB (SLO: <46.000MB -3.5%) vs baseline: +4.5% ✅ bytesio_aspectTime: ✅ 3.918ms (SLO: <5.000ms 📉 -21.6%) vs baseline: -0.8% Memory: ✅ 44.631MB (SLO: <46.000MB -3.0%) vs baseline: +5.2% ✅ bytesio_noaspectTime: ✅ 321.829µs (SLO: <420.000µs 📉 -23.4%) vs baseline: +0.5% Memory: ✅ 44.545MB (SLO: <46.000MB -3.2%) vs baseline: +5.0% ✅ capitalize_aspectTime: ✅ 89.399µs (SLO: <300.000µs 📉 -70.2%) vs baseline: -0.2% Memory: ✅ 44.545MB (SLO: <46.000MB -3.2%) vs baseline: +5.2% ✅ capitalize_noaspectTime: ✅ 277.148µs (SLO: <300.000µs -7.6%) vs baseline: +5.7% Memory: ✅ 44.499MB (SLO: <46.000MB -3.3%) vs baseline: +5.0% ✅ casefold_aspectTime: ✅ 89.457µs (SLO: <500.000µs 📉 -82.1%) vs baseline: -0.5% Memory: ✅ 44.569MB (SLO: <46.000MB -3.1%) vs baseline: +5.0% ✅ casefold_noaspectTime: ✅ 315.857µs (SLO: <500.000µs 📉 -36.8%) vs baseline: -1.4% Memory: ✅ 44.486MB (SLO: <46.000MB -3.3%) vs baseline: +5.0% ✅ decode_aspectTime: ✅ 88.680µs (SLO: <100.000µs 📉 -11.3%) vs baseline: +0.2% Memory: ✅ 44.453MB (SLO: <46.000MB -3.4%) vs baseline: +5.0% ✅ decode_noaspectTime: ✅ 158.697µs (SLO: <210.000µs 📉 -24.4%) vs baseline: +2.0% Memory: ✅ 44.566MB (SLO: <46.000MB -3.1%) vs baseline: +5.1% ✅ encode_aspectTime: ✅ 85.539µs (SLO: <200.000µs 📉 -57.2%) vs baseline: -0.2% Memory: ✅ 44.620MB (SLO: <46.000MB -3.0%) vs baseline: +5.3% ✅ encode_noaspectTime: ✅ 143.741µs (SLO: <200.000µs 📉 -28.1%) vs baseline: +0.5% Memory: ✅ 44.505MB (SLO: <46.000MB -3.3%) vs baseline: +5.0% ✅ format_aspectTime: ✅ 14.599ms (SLO: <19.200ms 📉 -24.0%) vs baseline: -0.3% Memory: ✅ 44.489MB (SLO: <46.000MB -3.3%) vs baseline: +4.7% ✅ format_map_aspectTime: ✅ 16.444ms (SLO: <21.500ms 📉 -23.5%) vs baseline: -0.1% Memory: ✅ 44.563MB (SLO: <46.000MB -3.1%) vs baseline: +4.7% ✅ format_map_noaspectTime: ✅ 376.560µs (SLO: <500.000µs 📉 -24.7%) vs baseline: +0.7% Memory: ✅ 44.722MB (SLO: <46.000MB -2.8%) vs baseline: +5.5% ✅ format_noaspectTime: ✅ 308.132µs (SLO: <500.000µs 📉 -38.4%) vs baseline: +0.2% Memory: ✅ 44.546MB (SLO: <46.000MB -3.2%) vs baseline: +4.9% ✅ index_aspectTime: ✅ 130.894µs (SLO: <300.000µs 📉 -56.4%) vs baseline: +7.0% Memory: ✅ 44.503MB (SLO: <46.000MB -3.3%) vs baseline: +4.7% ✅ index_noaspectTime: ✅ 40.471µs (SLO: <300.000µs 📉 -86.5%) vs baseline: -0.1% Memory: ✅ 44.446MB (SLO: <46.000MB -3.4%) vs baseline: +4.8% ✅ join_aspectTime: ✅ 215.167µs (SLO: <300.000µs 📉 -28.3%) vs baseline: ~same Memory: ✅ 44.464MB (SLO: <46.000MB -3.3%) vs baseline: +4.7% ✅ join_noaspectTime: ✅ 145.996µs (SLO: <300.000µs 📉 -51.3%) vs baseline: -1.0% Memory: ✅ 44.522MB (SLO: <46.000MB -3.2%) vs baseline: +4.8% ✅ ljust_aspectTime: ✅ 509.019µs (SLO: <700.000µs 📉 -27.3%) vs baseline: +2.1% Memory: ✅ 44.608MB (SLO: <46.000MB -3.0%) vs baseline: +4.9% ✅ ljust_noaspectTime: ✅ 276.088µs (SLO: <300.000µs -8.0%) vs baseline: +6.1% Memory: ✅ 44.810MB (SLO: <46.000MB -2.6%) vs baseline: +5.6% ✅ lower_aspectTime: ✅ 309.420µs (SLO: <500.000µs 📉 -38.1%) vs baseline: +1.1% Memory: ✅ 44.525MB (SLO: <46.000MB -3.2%) vs baseline: +4.9% ✅ lower_noaspectTime: ✅ 242.523µs (SLO: <300.000µs 📉 -19.2%) vs baseline: -2.5% Memory: ✅ 44.485MB (SLO: <46.000MB -3.3%) vs baseline: +4.8% ✅ lstrip_aspectTime: ✅ 0.282ms (SLO: <3.000ms 📉 -90.6%) vs baseline: +1.1% Memory: ✅ 44.492MB (SLO: <46.000MB -3.3%) vs baseline: +4.9% ✅ lstrip_noaspectTime: ✅ 0.179ms (SLO: <3.000ms 📉 -94.0%) vs baseline: -1.1% Memory: ✅ 44.647MB (SLO: <46.000MB -2.9%) vs baseline: +5.0% ✅ modulo_aspectTime: ✅ 14.312ms (SLO: <18.750ms 📉 -23.7%) vs baseline: -0.2% Memory: ✅ 44.530MB (SLO: <46.000MB -3.2%) vs baseline: +4.7% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 14.763ms (SLO: <19.350ms 📉 -23.7%) vs baseline: ~same Memory: ✅ 44.638MB (SLO: <46.000MB -3.0%) vs baseline: +4.9% ✅ modulo_aspect_for_bytesTime: ✅ 14.348ms (SLO: <18.900ms 📉 -24.1%) vs baseline: -0.1% Memory: ✅ 44.709MB (SLO: <46.000MB -2.8%) vs baseline: +5.0% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 14.576ms (SLO: <19.150ms 📉 -23.9%) vs baseline: ~same Memory: ✅ 44.803MB (SLO: <46.000MB -2.6%) vs baseline: +5.1% ✅ modulo_noaspectTime: ✅ 0.369ms (SLO: <3.000ms 📉 -87.7%) vs baseline: +0.7% Memory: ✅ 44.646MB (SLO: <46.000MB -2.9%) vs baseline: +5.2% ✅ replace_aspectTime: ✅ 18.364ms (SLO: <24.000ms 📉 -23.5%) vs baseline: -0.4% Memory: ✅ 44.589MB (SLO: <46.000MB -3.1%) vs baseline: +5.1% ✅ replace_noaspectTime: ✅ 289.635µs (SLO: <300.000µs -3.5%) vs baseline: +1.6% Memory: ✅ 44.547MB (SLO: <46.000MB -3.2%) vs baseline: +5.0% ✅ repr_aspectTime: ✅ 319.808µs (SLO: <420.000µs 📉 -23.9%) vs baseline: -3.2% Memory: ✅ 44.589MB (SLO: <46.000MB -3.1%) vs baseline: +4.9% ✅ repr_noaspectTime: ✅ 46.858µs (SLO: <90.000µs 📉 -47.9%) vs baseline: -0.1% Memory: ✅ 44.458MB (SLO: <46.000MB -3.4%) vs baseline: +4.8% ✅ rstrip_aspectTime: ✅ 382.408µs (SLO: <500.000µs 📉 -23.5%) vs baseline: -0.2% Memory: ✅ 44.615MB (SLO: <46.000MB -3.0%) vs baseline: +5.1% ✅ rstrip_noaspectTime: ✅ 186.647µs (SLO: <300.000µs 📉 -37.8%) vs baseline: +0.6% Memory: ✅ 44.705MB (SLO: <46.000MB -2.8%) vs baseline: +5.4% ✅ slice_aspectTime: ✅ 183.492µs (SLO: <300.000µs 📉 -38.8%) vs baseline: +0.6% Memory: ✅ 44.465MB (SLO: <46.000MB -3.3%) vs baseline: +4.4% ✅ slice_noaspectTime: ✅ 54.353µs (SLO: <90.000µs 📉 -39.6%) vs baseline: -0.1% Memory: ✅ 44.547MB (SLO: <46.000MB -3.2%) vs baseline: +4.9% ✅ stringio_aspectTime: ✅ 4.497ms (SLO: <5.000ms 📉 -10.1%) vs baseline: 📈 +14.6% Memory: ✅ 44.571MB (SLO: <46.000MB -3.1%) vs baseline: +4.9% ✅ stringio_noaspectTime: ✅ 354.493µs (SLO: <500.000µs 📉 -29.1%) vs baseline: ~same Memory: ✅ 44.647MB (SLO: <46.000MB -2.9%) vs baseline: +5.2% ✅ strip_aspectTime: ✅ 280.893µs (SLO: <350.000µs 📉 -19.7%) vs baseline: -0.2% Memory: ✅ 44.610MB (SLO: <46.000MB -3.0%) vs baseline: +4.8% ✅ strip_noaspectTime: ✅ 179.419µs (SLO: <240.000µs 📉 -25.2%) vs baseline: -1.3% Memory: ✅ 44.750MB (SLO: <46.000MB -2.7%) vs baseline: +5.5% ✅ swapcase_aspectTime: ✅ 345.913µs (SLO: <500.000µs 📉 -30.8%) vs baseline: -0.6% Memory: ✅ 44.449MB (SLO: <46.000MB -3.4%) vs baseline: +4.7% ✅ swapcase_noaspectTime: ✅ 286.313µs (SLO: <400.000µs 📉 -28.4%) vs baseline: -0.5% Memory: ✅ 44.669MB (SLO: <46.000MB -2.9%) vs baseline: +5.2% ✅ title_aspectTime: ✅ 340.333µs (SLO: <500.000µs 📉 -31.9%) vs baseline: +1.6% Memory: ✅ 44.463MB (SLO: <46.000MB -3.3%) vs baseline: +4.7% ✅ title_noaspectTime: ✅ 272.456µs (SLO: <400.000µs 📉 -31.9%) vs baseline: ~same Memory: ✅ 44.566MB (SLO: <46.000MB -3.1%) vs baseline: +5.1% ✅ translate_aspectTime: ✅ 509.217µs (SLO: <700.000µs 📉 -27.3%) vs baseline: +1.0% Memory: ✅ 44.509MB (SLO: <46.000MB -3.2%) vs baseline: +4.8% ✅ translate_noaspectTime: ✅ 431.983µs (SLO: <500.000µs 📉 -13.6%) vs baseline: -2.4% Memory: ✅ 44.524MB (SLO: <46.000MB -3.2%) vs baseline: +5.0% ✅ upper_aspectTime: ✅ 309.821µs (SLO: <500.000µs 📉 -38.0%) vs baseline: +2.6% Memory: ✅ 44.566MB (SLO: <46.000MB -3.1%) vs baseline: +4.8% ✅ upper_noaspectTime: ✅ 248.019µs (SLO: <400.000µs 📉 -38.0%) vs baseline: +1.0% Memory: ✅ 44.545MB (SLO: <46.000MB -3.2%) vs baseline: +4.9% 📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 494.202µs (SLO: <700.000µs 📉 -29.4%) vs baseline: 📈 +15.5% Memory: ✅ 44.550MB (SLO: <46.000MB -3.2%) vs baseline: +4.8% ✅ ospathbasename_noaspectTime: ✅ 432.668µs (SLO: <700.000µs 📉 -38.2%) vs baseline: +0.5% Memory: ✅ 44.559MB (SLO: <46.000MB -3.1%) vs baseline: +4.8% ✅ ospathjoin_aspectTime: ✅ 617.466µs (SLO: <700.000µs 📉 -11.8%) vs baseline: ~same Memory: ✅ 44.560MB (SLO: <46.000MB -3.1%) vs baseline: +5.0% ✅ ospathjoin_noaspectTime: ✅ 621.442µs (SLO: <700.000µs 📉 -11.2%) vs baseline: -0.5% Memory: ✅ 44.537MB (SLO: <46.000MB -3.2%) vs baseline: +4.7% ✅ ospathnormcase_aspectTime: ✅ 355.196µs (SLO: <700.000µs 📉 -49.3%) vs baseline: +0.4% Memory: ✅ 44.564MB (SLO: <46.000MB -3.1%) vs baseline: +4.8% ✅ ospathnormcase_noaspectTime: ✅ 360.661µs (SLO: <700.000µs 📉 -48.5%) vs baseline: -0.7% Memory: ✅ 44.520MB (SLO: <46.000MB -3.2%) vs baseline: +4.8% ✅ ospathsplit_aspectTime: ✅ 490.020µs (SLO: <700.000µs 📉 -30.0%) vs baseline: +0.2% Memory: ✅ 44.453MB (SLO: <46.000MB -3.4%) vs baseline: +4.7% ✅ ospathsplit_noaspectTime: ✅ 492.966µs (SLO: <700.000µs 📉 -29.6%) vs baseline: -1.3% Memory: ✅ 44.523MB (SLO: <46.000MB -3.2%) vs baseline: +4.8% ✅ ospathsplitdrive_aspectTime: ✅ 372.060µs (SLO: <700.000µs 📉 -46.8%) vs baseline: -1.0% Memory: ✅ 44.518MB (SLO: <46.000MB -3.2%) vs baseline: +4.9% ✅ ospathsplitdrive_noaspectTime: ✅ 72.507µs (SLO: <700.000µs 📉 -89.6%) vs baseline: -0.4% Memory: ✅ 44.626MB (SLO: <46.000MB -3.0%) vs baseline: +5.0% ✅ ospathsplitext_aspectTime: ✅ 462.561µs (SLO: <700.000µs 📉 -33.9%) vs baseline: +0.3% Memory: ✅ 44.569MB (SLO: <46.000MB -3.1%) vs baseline: +4.9% ✅ ospathsplitext_noaspectTime: ✅ 469.945µs (SLO: <700.000µs 📉 -32.9%) vs baseline: -0.3% Memory: ✅ 44.536MB (SLO: <46.000MB -3.2%) vs baseline: +5.0% 📈 telemetryaddmetric - 30/30✅ 1-count-metric-1-timesTime: ✅ 3.336µs (SLO: <20.000µs 📉 -83.3%) vs baseline: 📈 +15.0% Memory: ✅ 35.625MB (SLO: <38.000MB -6.2%) vs baseline: +4.8% ✅ 1-count-metrics-100-timesTime: ✅ 200.659µs (SLO: <220.000µs -8.8%) vs baseline: +0.3% Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +4.6% ✅ 1-distribution-metric-1-timesTime: ✅ 3.214µs (SLO: <20.000µs 📉 -83.9%) vs baseline: +0.3% Memory: ✅ 35.645MB (SLO: <38.000MB -6.2%) vs baseline: +5.2% ✅ 1-distribution-metrics-100-timesTime: ✅ 213.617µs (SLO: <230.000µs -7.1%) vs baseline: +1.0% Memory: ✅ 35.586MB (SLO: <38.000MB -6.4%) vs baseline: +4.9% ✅ 1-gauge-metric-1-timesTime: ✅ 2.167µs (SLO: <20.000µs 📉 -89.2%) vs baseline: +0.5% Memory: ✅ 35.547MB (SLO: <38.000MB -6.5%) vs baseline: +4.9% ✅ 1-gauge-metrics-100-timesTime: ✅ 136.069µs (SLO: <150.000µs -9.3%) vs baseline: +0.1% Memory: ✅ 35.684MB (SLO: <38.000MB -6.1%) vs baseline: +5.1% ✅ 1-rate-metric-1-timesTime: ✅ 3.013µs (SLO: <20.000µs 📉 -84.9%) vs baseline: ~same Memory: ✅ 35.527MB (SLO: <38.000MB -6.5%) vs baseline: +4.7% ✅ 1-rate-metrics-100-timesTime: ✅ 214.695µs (SLO: <250.000µs 📉 -14.1%) vs baseline: +0.3% Memory: ✅ 35.665MB (SLO: <38.000MB -6.1%) vs baseline: +5.4% ✅ 100-count-metrics-100-timesTime: ✅ 20.299ms (SLO: <22.000ms -7.7%) vs baseline: -0.3% Memory: ✅ 35.704MB (SLO: <38.000MB -6.0%) vs baseline: +5.2% ✅ 100-distribution-metrics-100-timesTime: ✅ 2.259ms (SLO: <2.550ms 📉 -11.4%) vs baseline: +0.4% Memory: ✅ 35.704MB (SLO: <38.000MB -6.0%) vs baseline: +5.2% ✅ 100-gauge-metrics-100-timesTime: ✅ 1.415ms (SLO: <1.550ms -8.7%) vs baseline: +0.9% Memory: ✅ 35.547MB (SLO: <38.000MB -6.5%) vs baseline: +4.3% ✅ 100-rate-metrics-100-timesTime: ✅ 2.212ms (SLO: <2.550ms 📉 -13.3%) vs baseline: ~same Memory: ✅ 35.625MB (SLO: <38.000MB -6.2%) vs baseline: +4.9% ✅ flush-1-metricTime: ✅ 4.441µs (SLO: <20.000µs 📉 -77.8%) vs baseline: -0.6% Memory: ✅ 35.684MB (SLO: <38.000MB -6.1%) vs baseline: +5.1% ✅ flush-100-metricsTime: ✅ 172.349µs (SLO: <250.000µs 📉 -31.1%) vs baseline: -0.2% Memory: ✅ 35.566MB (SLO: <38.000MB -6.4%) vs baseline: +4.9% ✅ flush-1000-metricsTime: ✅ 2.185ms (SLO: <2.500ms 📉 -12.6%) vs baseline: ~same Memory: ✅ 36.864MB (SLO: <38.750MB -4.9%) vs baseline: +5.3% 🟡 Near SLO Breach (3 suites)🟡 iastpropagation - 8/8✅ no-propagationTime: ✅ 48.824µs (SLO: <60.000µs 📉 -18.6%) vs baseline: -0.2% Memory: ✅ 41.308MB (SLO: <42.000MB 🟡 -1.6%) vs baseline: +4.7% ✅ propagation_enabledTime: ✅ 134.629µs (SLO: <190.000µs 📉 -29.1%) vs baseline: -0.8% Memory: ✅ 41.350MB (SLO: <42.000MB 🟡 -1.5%) vs baseline: +4.9% ✅ propagation_enabled_100Time: ✅ 1.555ms (SLO: <2.300ms 📉 -32.4%) vs baseline: -0.4% Memory: ✅ 41.432MB (SLO: <42.000MB 🟡 -1.4%) vs baseline: +4.8% ✅ propagation_enabled_1000Time: ✅ 28.708ms (SLO: <34.550ms 📉 -16.9%) vs baseline: -0.3% Memory: ✅ 41.388MB (SLO: <42.000MB 🟡 -1.5%) vs baseline: +4.8% 🟡 sethttpmeta - 32/32✅ all-disabledTime: ✅ 10.542µs (SLO: <20.000µs 📉 -47.3%) vs baseline: -0.1% Memory: ✅ 37.670MB (SLO: <38.750MB -2.8%) vs baseline: +4.9% ✅ all-enabledTime: ✅ 41.281µs (SLO: <50.000µs 📉 -17.4%) vs baseline: +2.7% Memory: ✅ 37.729MB (SLO: <38.750MB -2.6%) vs baseline: +5.2% ✅ collectipvariant_existsTime: ✅ 41.170µs (SLO: <50.000µs 📉 -17.7%) vs baseline: +0.3% Memory: ✅ 37.788MB (SLO: <38.750MB -2.5%) vs baseline: +5.1% ✅ no-collectipvariantTime: ✅ 40.206µs (SLO: <50.000µs 📉 -19.6%) vs baseline: ~same Memory: ✅ 37.729MB (SLO: <38.750MB -2.6%) vs baseline: +5.1% ✅ no-useragentvariantTime: ✅ 39.014µs (SLO: <50.000µs 📉 -22.0%) vs baseline: +0.5% Memory: ✅ 37.631MB (SLO: <38.750MB -2.9%) vs baseline: +4.5% ✅ obfuscation-no-queryTime: ✅ 40.729µs (SLO: <50.000µs 📉 -18.5%) vs baseline: ~same Memory: ✅ 37.650MB (SLO: <38.750MB -2.8%) vs baseline: +4.7% ✅ obfuscation-regular-case-explicit-queryTime: ✅ 75.819µs (SLO: <90.000µs 📉 -15.8%) vs baseline: -0.2% Memory: ✅ 38.083MB (SLO: <38.750MB 🟡 -1.7%) vs baseline: +4.7% ✅ obfuscation-regular-case-implicit-queryTime: ✅ 76.179µs (SLO: <90.000µs 📉 -15.4%) vs baseline: -0.4% Memory: ✅ 38.044MB (SLO: <38.750MB 🟡 -1.8%) vs baseline: +4.7% ✅ obfuscation-send-querystring-disabledTime: ✅ 154.379µs (SLO: <170.000µs -9.2%) vs baseline: ~same Memory: ✅ 38.024MB (SLO: <38.750MB 🟡 -1.9%) vs baseline: +4.7% ✅ obfuscation-worst-case-explicit-queryTime: ✅ 148.881µs (SLO: <160.000µs -6.9%) vs baseline: -0.2% Memory: ✅ 38.181MB (SLO: <38.750MB 🟡 -1.5%) vs baseline: +5.1% ✅ obfuscation-worst-case-implicit-queryTime: ✅ 155.006µs (SLO: <170.000µs -8.8%) vs baseline: -0.1% Memory: ✅ 38.142MB (SLO: <38.750MB 🟡 -1.6%) vs baseline: +4.9% ✅ useragentvariant_exists_1Time: ✅ 39.691µs (SLO: <50.000µs 📉 -20.6%) vs baseline: ~same Memory: ✅ 37.729MB (SLO: <38.750MB -2.6%) vs baseline: +5.0% ✅ useragentvariant_exists_2Time: ✅ 40.875µs (SLO: <50.000µs 📉 -18.2%) vs baseline: +0.6% Memory: ✅ 37.631MB (SLO: <38.750MB -2.9%) vs baseline: +4.5% ✅ useragentvariant_exists_3Time: ✅ 40.208µs (SLO: <50.000µs 📉 -19.6%) vs baseline: -0.2% Memory: ✅ 37.650MB (SLO: <38.750MB -2.8%) vs baseline: +4.6% ✅ useragentvariant_not_exists_1Time: ✅ 39.720µs (SLO: <50.000µs 📉 -20.6%) vs baseline: +0.4% Memory: ✅ 37.729MB (SLO: <38.750MB -2.6%) vs baseline: +5.2% ✅ useragentvariant_not_exists_2Time: ✅ 39.725µs (SLO: <50.000µs 📉 -20.5%) vs baseline: ~same Memory: ✅ 37.729MB (SLO: <38.750MB -2.6%) vs baseline: +5.2% 🟡 tracer - 6/6✅ largeTime: ✅ 31.392ms (SLO: <32.950ms -4.7%) vs baseline: -0.2% Memory: ✅ 36.943MB (SLO: <39.250MB -5.9%) vs baseline: +4.9% ✅ mediumTime: ✅ 3.103ms (SLO: <3.200ms -3.0%) vs baseline: +0.4% Memory: ✅ 35.606MB (SLO: <38.750MB -8.1%) vs baseline: +4.8% ✅ smallTime: ✅ 364.394µs (SLO: <370.000µs 🟡 -1.5%) vs baseline: +4.4% Memory: ✅ 35.606MB (SLO: <38.750MB -8.1%) vs baseline: +4.7%
|
Description
Adds APM tracing for llama-index as well as LLM Observability.
Testing
Risks
Additional Notes