Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Svls 6036 respect timeouts #851

Open
wants to merge 7 commits into
base: main
Choose a base branch
from
Open

Conversation

alexgallotta
Copy link
Contributor

this change make the configured flushing time out respected

  • Do not keep trying shipping for each batch if a 500 error is met
  • send sketches and distributions in parallel

@alexgallotta alexgallotta requested a review from a team as a code owner February 3, 2025 22:05
@codecov-commenter
Copy link

codecov-commenter commented Feb 3, 2025

Codecov Report

Attention: Patch coverage is 55.29412% with 38 lines in your changes missing coverage. Please review.

Project coverage is 72.07%. Comparing base (7628bcb) to head (1470851).
Report is 8 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #851      +/-   ##
==========================================
+ Coverage   71.44%   72.07%   +0.63%     
==========================================
  Files         317      323       +6     
  Lines       46656    47968    +1312     
==========================================
+ Hits        33334    34574    +1240     
- Misses      13322    13394      +72     
Components Coverage Δ
crashtracker 43.29% <ø> (+1.02%) ⬆️
crashtracker-ffi 6.28% <ø> (-0.11%) ⬇️
datadog-alloc 98.73% <ø> (ø)
data-pipeline 92.22% <ø> (+0.74%) ⬆️
data-pipeline-ffi 89.93% <ø> (-0.16%) ⬇️
ddcommon 80.61% <ø> (ø)
ddcommon-ffi 62.11% <ø> (ø)
ddtelemetry 61.74% <ø> (+2.23%) ⬆️
ddtelemetry-ffi 22.46% <ø> (ø)
dogstatsd 89.69% <55.29%> (-0.32%) ⬇️
dogstatsd-client 79.77% <ø> (ø)
ipc 82.68% <ø> (ø)
profiling 79.98% <ø> (+1.01%) ⬆️
profiling-ffi 70.44% <ø> (+2.77%) ⬆️
serverless 0.00% <ø> (ø)
sidecar 42.10% <ø> (+0.30%) ⬆️
sidecar-ffi 13.14% <ø> (+2.36%) ⬆️
spawn-worker 54.37% <ø> (ø)
tinybytes 93.60% <ø> (ø)
trace-mini-agent 72.48% <ø> (ø)
trace-normalization 98.23% <ø> (ø)
trace-obfuscation 95.96% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 94.21% <ø> (+0.05%) ⬆️

dogstatsd/src/flusher.rs Outdated Show resolved Hide resolved
dogstatsd/src/flusher.rs Outdated Show resolved Hide resolved
@pr-commenter
Copy link

pr-commenter bot commented Feb 4, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-02-05 20:36:13

Comparing candidate commit 1470851 in PR branch SVLS-6036-respect-timeouts with baseline commit f2fb806 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1470851 1738787079 SVLS-6036-respect-timeouts
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.680µs 2.729µs ± 0.022µs 2.728µs ± 0.008µs 2.734µs 2.788µs 2.795µs 2.798µs 2.57% 1.318 3.124 0.79% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.726µs; 2.732µs] or [-0.110%; +0.110%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1470851 1738787079 SVLS-6036-respect-timeouts
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.379µs 5.434µs ± 0.030µs 5.440µs ± 0.031µs 5.464µs 5.481µs 5.484µs 5.490µs 0.93% 0.131 -1.399 0.55% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.430µs; 5.438µs] or [-0.076%; +0.076%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1470851 1738787079 SVLS-6036-respect-timeouts
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 69.250µs 69.465µs ± 0.180µs 69.440µs ± 0.051µs 69.487µs 69.689µs 69.962µs 71.179µs 2.50% 5.980 48.091 0.26% 0.013µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [69.440µs; 69.489µs] or [-0.036%; +0.036%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1470851 1738787079 SVLS-6036-respect-timeouts
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 37.992µs 38.696µs ± 1.122µs 38.158µs ± 0.093µs 38.429µs 41.056µs 41.121µs 42.112µs 10.36% 1.632 0.812 2.89% 0.079µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [38.540µs; 38.851µs] or [-0.402%; +0.402%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1470851 1738787079 SVLS-6036-respect-timeouts
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.579µs 28.185µs ± 14.271µs 18.981µs ± 0.251µs 37.224µs 46.383µs 56.651µs 149.148µs 685.79% 3.924 27.464 50.51% 1.009µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [26.207µs; 30.163µs] or [-7.017%; +7.017%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1470851 1738787079 SVLS-6036-respect-timeouts
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 700.396µs 702.012µs ± 0.792µs 702.015µs ± 0.420µs 702.385µs 702.875µs 703.486µs 709.681µs 1.09% 4.498 42.193 0.11% 0.056µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1409083.952op/s 1424478.001op/s ± 1599.132op/s 1424471.377op/s ± 851.930op/s 1425385.223op/s 1426471.811op/s 1426974.805op/s 1427764.193op/s 0.23% -4.418 41.201 0.11% 113.076op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 474.053µs 475.110µs ± 0.383µs 475.114µs ± 0.249µs 475.349µs 475.730µs 476.005µs 476.500µs 0.29% 0.101 0.676 0.08% 0.027µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2098634.496op/s 2104775.289op/s ± 1698.323op/s 2104759.065op/s ± 1103.542op/s 2105876.370op/s 2107372.831op/s 2109116.803op/s 2109470.880op/s 0.22% -0.094 0.672 0.08% 120.090op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 190.755µs 191.263µs ± 0.235µs 191.239µs ± 0.150µs 191.397µs 191.646µs 191.928µs 192.616µs 0.72% 1.164 4.579 0.12% 0.017µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5191681.542op/s 5228411.355op/s ± 6426.790op/s 5229063.133op/s ± 4093.646op/s 5232752.320op/s 5237518.686op/s 5240176.095op/s 5242323.021op/s 0.25% -1.145 4.464 0.12% 454.443op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 46.294µs 46.432µs ± 0.056µs 46.429µs ± 0.035µs 46.468µs 46.513µs 46.598µs 46.676µs 0.53% 0.581 1.802 0.12% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21424209.537op/s 21536908.535op/s ± 25998.323op/s 21538431.415op/s ± 16057.201op/s 21553695.909op/s 21579619.387op/s 21587939.584op/s 21601051.835op/s 0.29% -0.568 1.766 0.12% 1838.359op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.855µs 49.095µs ± 0.212µs 49.093µs ± 0.046µs 49.130µs 49.191µs 49.311µs 51.888µs 5.69% 11.510 149.484 0.43% 0.015µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19272315.896op/s 20369002.072op/s ± 83802.996op/s 20369675.665op/s ± 18959.535op/s 20394442.107op/s 20431079.432op/s 20441561.439op/s 20468901.598op/s 0.49% -11.261 145.192 0.41% 5925.767op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [701.903µs; 702.122µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1424256.377op/s; 1424699.625op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [475.057µs; 475.164µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2104539.918op/s; 2105010.660op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [191.230µs; 191.296µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5227520.663op/s; 5229302.046op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [46.424µs; 46.440µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21533305.417op/s; 21540511.652op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [49.066µs; 49.124µs] or [-0.060%; +0.060%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20357387.783op/s; 20380616.361op/s] or [-0.057%; +0.057%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1470851 1738787079 SVLS-6036-respect-timeouts
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 4.276µs 4.288µs ± 0.005µs 4.288µs ± 0.001µs 4.290µs 4.292µs 4.294µs 4.345µs 1.32% 8.240 97.425 0.11% 0.000µs 1 200
credit_card/is_card_number/ throughput 230149733.463op/s 233184565.637op/s ± 256895.311op/s 233195225.388op/s ± 70288.664op/s 233261150.358op/s 233446431.616op/s 233536532.183op/s 233878920.492op/s 0.29% -8.135 95.872 0.11% 18165.242op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 89.589µs 90.975µs ± 0.627µs 90.949µs ± 0.338µs 91.297µs 91.702µs 92.812µs 95.525µs 5.03% 2.165 13.758 0.69% 0.044µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 10468494.637op/s 10992543.754op/s ± 74706.751op/s 10995133.878op/s ± 40874.488op/s 11034164.819op/s 11093482.729op/s 11125507.835op/s 11162135.601op/s 1.52% -1.947 11.987 0.68% 5282.565op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 83.099µs 83.644µs ± 0.417µs 83.608µs ± 0.141µs 83.762µs 83.950µs 84.040µs 88.818µs 6.23% 9.581 116.836 0.50% 0.029µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 11258961.077op/s 11955681.702op/s ± 56946.457op/s 11960571.398op/s ± 20203.384op/s 11979579.911op/s 12003609.667op/s 12025009.538op/s 12033842.776op/s 0.61% -9.178 110.321 0.48% 4026.723op/s 1 200
credit_card/is_card_number/37828224631 execution_time 4.273µs 4.289µs ± 0.004µs 4.289µs ± 0.002µs 4.290µs 4.294µs 4.295µs 4.336µs 1.11% 6.095 67.178 0.10% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 230626941.341op/s 233178251.252op/s ± 237203.911op/s 233181182.281op/s ± 81671.480op/s 233268382.627op/s 233474332.341op/s 233532518.187op/s 234040955.963op/s 0.37% -5.997 65.925 0.10% 16772.849op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 80.571µs 80.912µs ± 0.164µs 80.889µs ± 0.066µs 80.954µs 81.347µs 81.421µs 81.493µs 0.75% 1.497 2.929 0.20% 0.012µs 1 200
credit_card/is_card_number/378282246310005 throughput 12271010.816op/s 12359087.657op/s ± 24952.574op/s 12362595.115op/s ± 10094.802op/s 12372859.518op/s 12389737.766op/s 12405376.037op/s 12411454.531op/s 0.40% -1.481 2.889 0.20% 1764.413op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 58.573µs 58.686µs ± 0.044µs 58.684µs ± 0.026µs 58.713µs 58.763µs 58.786µs 58.818µs 0.23% 0.096 0.110 0.07% 0.003µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 17001689.431op/s 17039742.884op/s ± 12748.334op/s 17040441.951op/s ± 7696.758op/s 17047651.776op/s 17061118.310op/s 17072273.706op/s 17072624.047op/s 0.19% -0.092 0.110 0.07% 901.443op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.390µs 6.444µs ± 0.006µs 6.444µs ± 0.002µs 6.446µs 6.452µs 6.456µs 6.460µs 0.25% -3.915 27.857 0.10% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 154792431.528op/s 155187299.431op/s ± 156946.936op/s 155184155.698op/s ± 53320.780op/s 155233872.031op/s 155294105.901op/s 155922484.627op/s 156501040.097op/s 0.85% 3.959 28.280 0.10% 11097.824op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 4.276µs 4.290µs ± 0.003µs 4.289µs ± 0.001µs 4.291µs 4.295µs 4.297µs 4.298µs 0.21% 0.031 4.335 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 232652597.617op/s 233111648.363op/s ± 141525.499op/s 233137701.190op/s ± 72875.528op/s 233193325.713op/s 233295784.365op/s 233343530.943op/s 233878897.046op/s 0.32% -0.019 4.378 0.06% 10007.364op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 69.186µs 70.006µs ± 0.367µs 70.016µs ± 0.246µs 70.244µs 70.650µs 70.771µs 71.085µs 1.53% 0.117 -0.264 0.52% 0.026µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 14067697.301op/s 14284823.427op/s ± 74761.948op/s 14282406.218op/s ± 50163.929op/s 14338482.336op/s 14403100.373op/s 14440810.084op/s 14453741.558op/s 1.20% -0.090 -0.277 0.52% 5286.468op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 64.064µs 65.183µs ± 0.428µs 65.163µs ± 0.324µs 65.490µs 65.920µs 66.154µs 66.172µs 1.55% 0.120 -0.332 0.66% 0.030µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 15112032.662op/s 15342071.071op/s ± 100732.804op/s 15346184.098op/s ± 76364.439op/s 15422546.606op/s 15501326.983op/s 15552539.457op/s 15609297.262op/s 1.71% -0.087 -0.332 0.65% 7122.885op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 4.272µs 4.288µs ± 0.003µs 4.288µs ± 0.001µs 4.290µs 4.293µs 4.295µs 4.295µs 0.16% -1.182 7.243 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 232810903.138op/s 233183617.207op/s ± 144616.399op/s 233182569.603op/s ± 76151.279op/s 233253135.098op/s 233398855.826op/s 233539015.761op/s 234092078.091op/s 0.39% 1.197 7.331 0.06% 10225.924op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 61.660µs 61.955µs ± 0.065µs 61.962µs ± 0.046µs 62.005µs 62.042µs 62.072µs 62.084µs 0.20% -0.868 1.623 0.11% 0.005µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 16107126.310op/s 16140884.749op/s ± 17069.537op/s 16138952.797op/s ± 11859.251op/s 16150870.264op/s 16172444.583op/s 16191232.852op/s 16217839.624op/s 0.49% 0.877 1.656 0.11% 1206.999op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 58.582µs 58.692µs ± 0.038µs 58.690µs ± 0.022µs 58.713µs 58.751µs 58.790µs 58.795µs 0.18% -0.029 0.314 0.06% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 17008123.816op/s 17038231.985op/s ± 10915.525op/s 17038534.339op/s ± 6490.491op/s 17044948.227op/s 17056769.619op/s 17066170.362op/s 17070147.726op/s 0.19% 0.033 0.314 0.06% 771.844op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.432µs 6.444µs ± 0.004µs 6.444µs ± 0.002µs 6.446µs 6.450µs 6.453µs 6.468µs 0.38% 1.065 7.786 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 154599966.610op/s 155175285.684op/s ± 93030.922op/s 155183674.678op/s ± 37309.869op/s 155218358.452op/s 155285051.953op/s 155411027.321op/s 155482823.256op/s 0.19% -1.049 7.712 0.06% 6578.280op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [4.288µs; 4.289µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/ throughput [233148962.418op/s; 233220168.857op/s] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [90.888µs; 91.062µs] or [-0.096%; +0.096%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [10982190.117op/s; 11002897.391op/s] or [-0.094%; +0.094%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [83.586µs; 83.702µs] or [-0.069%; +0.069%] None None None
credit_card/is_card_number/ 378282246310005 throughput [11947789.471op/s; 11963573.933op/s] or [-0.066%; +0.066%] None None None
credit_card/is_card_number/37828224631 execution_time [4.288µs; 4.289µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number/37828224631 throughput [233145377.071op/s; 233211125.433op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number/378282246310005 execution_time [80.890µs; 80.935µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number/378282246310005 throughput [12355629.470op/s; 12362545.843op/s] or [-0.028%; +0.028%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [58.680µs; 58.692µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [17037976.088op/s; 17041509.681op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.443µs; 6.445µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number/x371413321323331 throughput [155165548.096op/s; 155209050.767op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/ execution_time [4.289µs; 4.290µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/ throughput [233092034.290op/s; 233131262.436op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [69.955µs; 70.057µs] or [-0.073%; +0.073%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [14274462.140op/s; 14295184.714op/s] or [-0.073%; +0.073%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [65.124µs; 65.242µs] or [-0.091%; +0.091%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [15328110.473op/s; 15356031.668op/s] or [-0.091%; +0.091%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [4.288µs; 4.289µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [233163574.765op/s; 233203659.649op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [61.945µs; 61.964µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [16138519.076op/s; 16143250.423op/s] or [-0.015%; +0.015%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [58.686µs; 58.697µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [17036719.198op/s; 17039744.772op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.444µs; 6.445µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [155162392.493op/s; 155188178.875op/s] or [-0.008%; +0.008%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1470851 1738787079 SVLS-6036-respect-timeouts
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.414µs 3.335µs ± 1.486µs 3.133µs ± 0.025µs 3.157µs 3.738µs 14.546µs 15.536µs 395.93% 7.455 56.219 44.46% 0.105µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.129µs; 3.541µs] or [-6.177%; +6.177%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1470851 1738787079 SVLS-6036-respect-timeouts
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 260.660ns 275.087ns ± 15.732ns 267.302ns ± 4.342ns 281.851ns 313.204ns 320.961ns 327.321ns 22.45% 1.470 1.251 5.70% 1.112ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [272.907ns; 277.268ns] or [-0.793%; +0.793%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1470851 1738787079 SVLS-6036-respect-timeouts
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 137.653µs 139.079µs ± 0.327µs 139.097µs ± 0.145µs 139.234µs 139.462µs 139.815µs 141.458µs 1.70% 1.164 15.106 0.23% 0.023µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [139.033µs; 139.124µs] or [-0.033%; +0.033%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1470851 1738787079 SVLS-6036-respect-timeouts
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 179.488µs 182.289µs ± 1.435µs 181.982µs ± 0.899µs 183.137µs 184.730µs 186.641µs 187.468µs 3.01% 0.907 0.899 0.79% 0.101µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5334241.577op/s 5486130.339op/s ± 42892.093op/s 5495040.659op/s ± 26998.083op/s 5516781.588op/s 5542193.981op/s 5556865.990op/s 5571406.982op/s 1.39% -0.859 0.770 0.78% 3032.929op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 20.907µs 21.087µs ± 0.105µs 21.062µs ± 0.062µs 21.144µs 21.290µs 21.420µs 21.492µs 2.05% 1.192 1.678 0.50% 0.007µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 46527999.741op/s 47423973.601op/s ± 235253.296op/s 47479979.486op/s ± 140914.481op/s 47588829.206op/s 47692529.015op/s 47765950.914op/s 47829954.944op/s 0.74% -1.159 1.563 0.49% 16634.920op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 14.153µs 14.285µs ± 0.077µs 14.270µs ± 0.054µs 14.345µs 14.432µs 14.476µs 14.492µs 1.56% 0.609 -0.384 0.54% 0.005µs 1 200
normalization/normalize_name/normalize_name/good throughput 69001343.002op/s 70007734.550op/s ± 377422.998op/s 70076147.562op/s ± 266839.484op/s 70301712.947op/s 70484335.115op/s 70620189.285op/s 70655829.709op/s 0.83% -0.589 -0.418 0.54% 26687.836op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [182.090µs; 182.488µs] or [-0.109%; +0.109%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5480185.908op/s; 5492074.771op/s] or [-0.108%; +0.108%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [21.072µs; 21.101µs] or [-0.069%; +0.069%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [47391369.757op/s; 47456577.445op/s] or [-0.069%; +0.069%] None None None
normalization/normalize_name/normalize_name/good execution_time [14.274µs; 14.295µs] or [-0.075%; +0.075%] None None None
normalization/normalize_name/normalize_name/good throughput [69955427.352op/s; 70060041.748op/s] or [-0.075%; +0.075%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1470851 1738787079 SVLS-6036-respect-timeouts
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 57.214ms 57.662ms ± 0.212ms 57.696ms ± 0.111ms 57.782ms 57.919ms 58.258ms 58.711ms 1.76% 0.881 4.069 0.37% 0.015ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [57.632ms; 57.691ms] or [-0.051%; +0.051%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1470851 1738787079 SVLS-6036-respect-timeouts
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 6.351ms 6.366ms ± 0.007ms 6.366ms ± 0.004ms 6.370ms 6.376ms 6.380ms 6.416ms 0.78% 2.104 11.808 0.11% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.365ms; 6.367ms] or [-0.016%; +0.016%] None None None

Baseline

Omitted due to size.

dogstatsd/src/flusher.rs Show resolved Hide resolved
dogstatsd/src/datadog.rs Outdated Show resolved Hide resolved
.send()
.await;
debug!("Sending body: {:?}", &series);
let body = serde_json::to_vec(&series).expect("failed to serialize series");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
let body = serde_json::to_vec(&series).expect("failed to serialize series");
let body = serde_json::to_vec(&series).context("failed to serialize series")?;

Lets avoid the use of panic as much as possible.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just moved the old behavior, but agree, I will handle the error safely

let url = format!("{}/api/beta/sketches", &self.metrics_intake_url_prefix);
debug!("Sending distributions: {:?}", &sketches);
let body = sketches.write_to_bytes().expect("can't write to buffer");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
let body = sketches.write_to_bytes().expect("can't write to buffer");
let body = sketches.write_to_bytes().context("can't write to buffer")?;

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just moved the old behavior, but agree, I will handle the error safely

self.dd_api.ship_series(&a_batch).await;
// TODO(astuyve) retry and do not panic
let dd_api_clone = self.dd_api.clone();
tokio::spawn(async move {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we wait for this to return when we flush? Otherwise we may lose data here

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants