Conversation
# What does this PR do? * breaking changes markers are only for major changes (as spec-ed in conventional commits https://www.conventionalcommits.org/en/v1.0.0/#summary) * a pr can be marked as a breaking change even if the API stays stable * ci|docs|style|test|build|chore changes should not touch the public API * other types can do whatever * a PR label "skip-pr-title-semver-check" has been added to break glass on this check
95eec88 to
d39462f
Compare
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #1710 +/- ##
=======================================
Coverage 71.25% 71.25%
=======================================
Files 429 429
Lines 63547 63547
=======================================
+ Hits 45279 45283 +4
+ Misses 18268 18264 -4
🚀 New features to boost your workflow:
|
BenchmarksComparisonBenchmark execution time: 2026-03-12 11:10:12 Comparing candidate commit 3500175 in PR branch Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 2 unstable metrics.
|
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | 13.889ms | 13.935ms ± 0.029ms | 13.930ms ± 0.012ms | 13.944ms | 13.980ms | 14.047ms | 14.101ms | 1.23% | 2.510 | 9.135 | 0.20% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | [13.931ms; 13.939ms] or [-0.028%; +0.028%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | 144.739µs | 146.381µs ± 1.848µs | 146.102µs ± 0.573µs | 146.672µs | 148.198µs | 153.640µs | 164.293µs | 12.45% | 6.114 | 49.608 | 1.26% | 0.131µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | [146.125µs; 146.637µs] or [-0.175%; +0.175%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 88.973µs | 89.281µs ± 0.177µs | 89.280µs ± 0.112µs | 89.376µs | 89.514µs | 89.654µs | 90.679µs | 1.57% | 2.636 | 18.211 | 0.20% | 0.013µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [89.257µs; 89.306µs] or [-0.027%; +0.027%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 33.498µs | 33.862µs ± 0.430µs | 33.673µs ± 0.128µs | 34.211µs | 34.337µs | 35.272µs | 36.887µs | 9.55% | 2.719 | 12.525 | 1.27% | 0.030µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [33.803µs; 33.922µs] or [-0.176%; +0.176%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | 726.003µs | 727.976µs ± 0.740µs | 727.867µs ± 0.443µs | 728.360µs | 729.292µs | 730.171µs | 731.489µs | 0.50% | 1.052 | 2.544 | 0.10% | 0.052µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | [727.873µs; 728.079µs] or [-0.014%; +0.014%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 248.890ns | 263.706ns ± 19.532ns | 255.039ns ± 4.667ns | 265.548ns | 304.961ns | 321.284ns | 322.978ns | 26.64% | 1.566 | 1.241 | 7.39% | 1.381ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [260.999ns; 266.412ns] or [-1.027%; +1.027%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.377µs | 2.427µs ± 0.046µs | 2.419µs ± 0.012µs | 2.430µs | 2.511µs | 2.712µs | 2.712µs | 12.14% | 3.998 | 20.769 | 1.88% | 0.003µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.421µs; 2.434µs] or [-0.261%; +0.261%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 4.955µs | 5.036µs ± 0.060µs | 4.997µs ± 0.021µs | 5.077µs | 5.157µs | 5.161µs | 5.164µs | 3.34% | 0.797 | -0.710 | 1.20% | 0.004µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.027µs; 5.044µs] or [-0.166%; +0.166%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 493.088µs | 494.055µs ± 0.432µs | 494.001µs ± 0.304µs | 494.331µs | 494.772µs | 495.072µs | 495.979µs | 0.40% | 0.618 | 1.098 | 0.09% | 0.031µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 2016213.493op/s | 2024068.769op/s ± 1767.596op/s | 2024288.652op/s ± 1244.347op/s | 2025408.126op/s | 2026691.197op/s | 2027446.670op/s | 2028035.335op/s | 0.19% | -0.611 | 1.073 | 0.09% | 124.988op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 370.491µs | 371.313µs ± 0.388µs | 371.288µs ± 0.300µs | 371.596µs | 372.005µs | 372.202µs | 372.350µs | 0.29% | 0.400 | -0.576 | 0.10% | 0.027µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2685641.777op/s | 2693149.706op/s ± 2814.883op/s | 2693327.646op/s ± 2177.598op/s | 2695423.634op/s | 2697085.080op/s | 2697923.308op/s | 2699124.064op/s | 0.22% | -0.396 | -0.581 | 0.10% | 199.042op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 167.301µs | 167.586µs ± 0.132µs | 167.568µs ± 0.073µs | 167.655µs | 167.793µs | 168.073µs | 168.209µs | 0.38% | 1.289 | 3.621 | 0.08% | 0.009µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5944972.779op/s | 5967087.268op/s ± 4710.391op/s | 5967726.535op/s ± 2600.217op/s | 5969837.811op/s | 5973242.070op/s | 5975313.546op/s | 5977233.967op/s | 0.16% | -1.280 | 3.583 | 0.08% | 333.075op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 36.940µs | 37.097µs ± 0.054µs | 37.093µs ± 0.027µs | 37.120µs | 37.181µs | 37.284µs | 37.320µs | 0.61% | 1.076 | 3.364 | 0.14% | 0.004µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26795457.193op/s | 26956750.403op/s ± 38915.498op/s | 26959463.355op/s ± 19402.612op/s | 26977529.266op/s | 27009705.220op/s | 27033820.121op/s | 27070839.610op/s | 0.41% | -1.058 | 3.316 | 0.14% | 2751.741op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 45.376µs | 45.636µs ± 0.105µs | 45.648µs ± 0.079µs | 45.718µs | 45.775µs | 45.820µs | 46.051µs | 0.88% | -0.049 | 0.213 | 0.23% | 0.007µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 21714866.432op/s | 21912664.462op/s ± 50325.979op/s | 21906874.122op/s ± 38004.239op/s | 21951737.520op/s | 21990834.131op/s | 22026701.926op/s | 22038081.805op/s | 0.60% | 0.065 | 0.184 | 0.23% | 3558.584op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [493.995µs; 494.115µs] or [-0.012%; +0.012%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [2023823.797op/s; 2024313.741op/s] or [-0.012%; +0.012%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [371.259µs; 371.367µs] or [-0.014%; +0.014%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2692759.590op/s; 2693539.821op/s] or [-0.014%; +0.014%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [167.568µs; 167.604µs] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5966434.453op/s; 5967740.083op/s] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [37.089µs; 37.104µs] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26951357.089op/s; 26962143.717op/s] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [45.621µs; 45.650µs] or [-0.032%; +0.032%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [21905689.766op/s; 21919639.159op/s] or [-0.032%; +0.032%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | 4.152ms | 4.160ms ± 0.007ms | 4.159ms ± 0.001ms | 4.160ms | 4.163ms | 4.166ms | 4.248ms | 2.15% | 11.232 | 143.870 | 0.16% | 0.000ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | [4.159ms; 4.160ms] or [-0.023%; +0.023%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 48.853ms | 49.248ms ± 1.207ms | 49.079ms ± 0.086ms | 49.168ms | 49.394ms | 58.686ms | 59.167ms | 20.55% | 7.774 | 59.513 | 2.45% | 0.085ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [49.081ms; 49.416ms] or [-0.340%; +0.340%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 10.637ms | 10.664ms ± 0.014ms | 10.661ms ± 0.008ms | 10.671ms | 10.688ms | 10.712ms | 10.715ms | 0.50% | 1.061 | 1.764 | 0.13% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [10.662ms; 10.666ms] or [-0.018%; +0.018%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | 3.574ms | 3.606ms ± 0.016ms | 3.603ms ± 0.009ms | 3.615ms | 3.638ms | 3.653ms | 3.663ms | 1.67% | 0.881 | 0.685 | 0.45% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | [3.604ms; 3.609ms] or [-0.063%; +0.063%] | None | None | None |
Group 14
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 165.204µs | 165.865µs ± 0.243µs | 165.820µs ± 0.129µs | 165.989µs | 166.346µs | 166.476µs | 166.698µs | 0.53% | 0.576 | 0.798 | 0.15% | 0.017µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [165.831µs; 165.899µs] or [-0.020%; +0.020%] | None | None | None |
Group 15
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 205.937µs | 206.500µs ± 0.301µs | 206.442µs ± 0.171µs | 206.666µs | 207.047µs | 207.345µs | 207.503µs | 0.51% | 0.697 | 0.249 | 0.15% | 0.021µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 4819201.784op/s | 4842631.529op/s ± 7052.432op/s | 4843976.816op/s ± 4009.527op/s | 4847516.140op/s | 4852903.765op/s | 4854687.705op/s | 4855846.327op/s | 0.25% | -0.689 | 0.234 | 0.15% | 498.682op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 18.569µs | 18.668µs ± 0.081µs | 18.657µs ± 0.032µs | 18.683µs | 18.837µs | 18.996µs | 19.051µs | 2.11% | 1.931 | 5.070 | 0.43% | 0.006µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 52491920.470op/s | 53568325.278op/s ± 230692.815op/s | 53600293.092op/s ± 91244.440op/s | 53709604.006op/s | 53838066.730op/s | 53853177.017op/s | 53854105.577op/s | 0.47% | -1.888 | 4.860 | 0.43% | 16312.445op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.741µs | 10.832µs ± 0.044µs | 10.826µs ± 0.028µs | 10.859µs | 10.913µs | 10.944µs | 10.999µs | 1.60% | 0.696 | 0.548 | 0.41% | 0.003µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 90914642.948op/s | 92318582.168op/s ± 376531.486op/s | 92370154.941op/s ± 241234.934op/s | 92576855.574op/s | 92899651.286op/s | 92941187.795op/s | 93098289.763op/s | 0.79% | -0.671 | 0.492 | 0.41% | 26624.797op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [206.458µs; 206.541µs] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [4841654.130op/s; 4843608.928op/s] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [18.657µs; 18.679µs] or [-0.060%; +0.060%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [53536353.472op/s; 53600297.083op/s] or [-0.060%; +0.060%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.826µs; 10.838µs] or [-0.057%; +0.057%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [92266398.525op/s; 92370765.811op/s] or [-0.057%; +0.057%] | None | None | None |
Group 16
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.191µs | 3.149µs ± 1.399µs | 2.984µs ± 0.029µs | 3.009µs | 3.353µs | 13.546µs | 14.923µs | 400.05% | 7.511 | 57.050 | 44.32% | 0.099µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [2.955µs; 3.343µs] or [-6.158%; +6.158%] | None | None | None |
Group 17
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.897µs | 3.914µs ± 0.003µs | 3.914µs ± 0.002µs | 3.916µs | 3.919µs | 3.923µs | 3.925µs | 0.29% | -0.023 | 4.179 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 254778975.499op/s | 255496378.339op/s ± 206823.464op/s | 255506221.582op/s ± 130155.585op/s | 255644170.586op/s | 255745660.330op/s | 255832248.062op/s | 256599193.967op/s | 0.43% | 0.038 | 4.225 | 0.08% | 14624.627op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 79.579µs | 80.146µs ± 0.139µs | 80.153µs ± 0.083µs | 80.230µs | 80.307µs | 80.392µs | 81.217µs | 1.33% | 1.872 | 17.387 | 0.17% | 0.010µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12312670.112op/s | 12477259.418op/s ± 21524.189op/s | 12476164.912op/s ± 12867.220op/s | 12489905.658op/s | 12504903.317op/s | 12515941.029op/s | 12566079.988op/s | 0.72% | -1.791 | 16.761 | 0.17% | 1521.990op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 67.780µs | 67.884µs ± 0.064µs | 67.874µs ± 0.029µs | 67.909µs | 67.960µs | 67.995µs | 68.554µs | 1.00% | 5.735 | 56.964 | 0.09% | 0.005µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 14586987.678op/s | 14731117.448op/s ± 13900.697op/s | 14733088.945op/s ± 6318.090op/s | 14738832.372op/s | 14745936.604op/s | 14751060.746op/s | 14753539.628op/s | 0.14% | -5.661 | 55.948 | 0.09% | 982.928op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.895µs | 3.914µs ± 0.003µs | 3.913µs ± 0.002µs | 3.916µs | 3.919µs | 3.923µs | 3.924µs | 0.27% | -0.473 | 6.921 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 254840218.674op/s | 255497725.826op/s ± 202864.564op/s | 255527162.539op/s ± 122691.440op/s | 255625275.561op/s | 255739000.885op/s | 255793528.008op/s | 256752515.798op/s | 0.48% | 0.494 | 7.030 | 0.08% | 14344.691op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 64.574µs | 64.674µs ± 0.054µs | 64.662µs ± 0.037µs | 64.713µs | 64.773µs | 64.813µs | 64.856µs | 0.30% | 0.647 | 0.074 | 0.08% | 0.004µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 15418829.116op/s | 15462186.786op/s ± 12869.146op/s | 15464919.377op/s ± 8812.008op/s | 15472244.341op/s | 15478920.576op/s | 15484099.287op/s | 15486223.456op/s | 0.14% | -0.643 | 0.065 | 0.08% | 909.986op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 45.376µs | 45.682µs ± 0.109µs | 45.676µs ± 0.075µs | 45.762µs | 45.855µs | 45.907µs | 45.961µs | 0.62% | 0.050 | -0.369 | 0.24% | 0.008µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 21757464.673op/s | 21890699.661op/s ± 52069.773op/s | 21893191.218op/s ± 35978.672op/s | 21928350.624op/s | 21972018.240op/s | 22004738.708op/s | 22038243.699op/s | 0.66% | -0.039 | -0.366 | 0.24% | 3681.889op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.556µs | 6.625µs ± 0.014µs | 6.631µs ± 0.006µs | 6.635µs | 6.640µs | 6.644µs | 6.649µs | 0.27% | -1.574 | 3.371 | 0.22% | 0.001µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 150401911.758op/s | 150937757.758op/s ± 327516.522op/s | 150805513.738op/s ± 138112.027op/s | 151155232.664op/s | 151583069.615op/s | 151823259.826op/s | 152537162.750op/s | 1.15% | 1.593 | 3.476 | 0.22% | 23158.915op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.899µs | 3.914µs ± 0.003µs | 3.913µs ± 0.002µs | 3.916µs | 3.918µs | 3.921µs | 3.922µs | 0.22% | -0.361 | 2.655 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 254983764.503op/s | 255519329.309op/s ± 188652.062op/s | 255540841.336op/s ± 126599.689op/s | 255638830.578op/s | 255782148.764op/s | 255874231.674op/s | 256489078.275op/s | 0.37% | 0.371 | 2.694 | 0.07% | 13339.715op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 65.568µs | 65.680µs ± 0.059µs | 65.670µs ± 0.037µs | 65.716µs | 65.794µs | 65.847µs | 65.872µs | 0.31% | 0.691 | 0.363 | 0.09% | 0.004µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15180893.744op/s | 15225445.267op/s ± 13555.893op/s | 15227610.225op/s ± 8613.838op/s | 15235121.615op/s | 15244586.849op/s | 15248574.673op/s | 15251404.450op/s | 0.16% | -0.686 | 0.353 | 0.09% | 958.546op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 53.339µs | 53.411µs ± 0.037µs | 53.405µs ± 0.024µs | 53.431µs | 53.468µs | 53.537µs | 53.581µs | 0.33% | 1.143 | 2.325 | 0.07% | 0.003µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 18663396.998op/s | 18722737.711op/s ± 12958.078op/s | 18724869.275op/s ± 8311.343op/s | 18732314.061op/s | 18738216.727op/s | 18743527.294op/s | 18748135.159op/s | 0.12% | -1.137 | 2.298 | 0.07% | 916.274op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.894µs | 3.914µs ± 0.003µs | 3.913µs ± 0.002µs | 3.915µs | 3.918µs | 3.921µs | 3.923µs | 0.24% | -1.027 | 10.503 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 254927374.123op/s | 255525693.097op/s ± 189223.562op/s | 255544189.150op/s ± 110997.141op/s | 255638780.406op/s | 255764185.261op/s | 255826066.335op/s | 256828048.999op/s | 0.50% | 1.053 | 10.673 | 0.07% | 13380.126op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 50.126µs | 50.214µs ± 0.038µs | 50.222µs ± 0.027µs | 50.239µs | 50.273µs | 50.311µs | 50.323µs | 0.20% | 0.077 | -0.354 | 0.08% | 0.003µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 19871714.175op/s | 19914866.906op/s ± 15010.749op/s | 19911445.836op/s ± 10759.113op/s | 19927994.676op/s | 19939516.368op/s | 19942963.324op/s | 19949625.201op/s | 0.19% | -0.073 | -0.359 | 0.08% | 1061.420op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 45.404µs | 45.699µs ± 0.111µs | 45.703µs ± 0.076µs | 45.786µs | 45.865µs | 45.936µs | 45.944µs | 0.53% | -0.194 | -0.366 | 0.24% | 0.008µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 21765629.884op/s | 21882610.712op/s ± 53361.740op/s | 21880608.313op/s ± 36496.892op/s | 21916814.032op/s | 21977940.054op/s | 22008301.070op/s | 22024730.454op/s | 0.66% | 0.205 | -0.359 | 0.24% | 3773.245op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.575µs | 6.622µs ± 0.015µs | 6.625µs ± 0.010µs | 6.633µs | 6.640µs | 6.642µs | 6.647µs | 0.33% | -0.851 | 0.335 | 0.22% | 0.001µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 150450209.798op/s | 151020803.230op/s ± 337127.817op/s | 150947327.259op/s ± 218576.969op/s | 151237117.120op/s | 151679694.003op/s | 152030077.076op/s | 152102453.795op/s | 0.77% | 0.861 | 0.364 | 0.22% | 23838.537op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.914µs; 3.914µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255467714.596op/s; 255525042.082op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [80.127µs; 80.165µs] or [-0.024%; +0.024%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12474276.372op/s; 12480242.463op/s] or [-0.024%; +0.024%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [67.875µs; 67.892µs] or [-0.013%; +0.013%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [14729190.945op/s; 14733043.951op/s] or [-0.013%; +0.013%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.914µs; 3.914µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255469610.749op/s; 255525840.904op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [64.666µs; 64.681µs] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [15460403.247op/s; 15463970.326op/s] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [45.667µs; 45.697µs] or [-0.033%; +0.033%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [21883483.291op/s; 21897916.031op/s] or [-0.033%; +0.033%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.623µs; 6.627µs] or [-0.030%; +0.030%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [150892367.118op/s; 150983148.398op/s] or [-0.030%; +0.030%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.913µs; 3.914µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255493183.947op/s; 255545474.670op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [65.671µs; 65.688µs] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15223566.550op/s; 15227323.983op/s] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [53.406µs; 53.416µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [18720941.846op/s; 18724533.576op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.913µs; 3.914µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255499468.531op/s; 255551917.663op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [50.209µs; 50.219µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [19912786.561op/s; 19916947.252op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [45.683µs; 45.714µs] or [-0.034%; +0.034%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [21875215.288op/s; 21890006.136op/s] or [-0.034%; +0.034%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.620µs; 6.624µs] or [-0.031%; +0.031%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [150974080.557op/s; 151067525.903op/s] or [-0.031%; +0.031%] | None | None | None |
Group 18
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | 190.422ns | 192.667ns ± 1.893ns | 192.416ns ± 1.383ns | 193.706ns | 196.398ns | 197.905ns | 201.156ns | 4.54% | 1.108 | 1.722 | 0.98% | 0.134ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | [192.404ns; 192.929ns] or [-0.136%; +0.136%] | None | None | None |
Group 19
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3500175 | 1773312701 | paullgdc/ci/relax_pr_title_semver_check |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 18.289µs | 26.520µs ± 9.980µs | 18.513µs ± 0.157µs | 35.371µs | 44.489µs | 45.093µs | 72.620µs | 292.27% | 0.902 | 0.607 | 37.54% | 0.706µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [25.137µs; 27.903µs] or [-5.215%; +5.215%] | None | None | None |
Baseline
Omitted due to size.
Artifact Size Benchmark Reportaarch64-alpine-linux-musl
aarch64-unknown-linux-gnu
libdatadog-x64-windows
libdatadog-x86-windows
x86_64-alpine-linux-musl
x86_64-unknown-linux-gnu
|
Co-authored-by: vianney <vianney.ruhlmann@datadoghq.com>
|
/merge |
|
View all feedbacks in Devflow UI.
This pull request is not mergeable according to GitHub. Common reasons include pending required checks, missing approvals, or merge conflicts — but it could also be blocked by other repository rules or settings.
The expected merge time in
This pull request was merged directly. |
What does this PR do?