Skip to content

ci: relax pr title semver check#1710

Merged
paullegranddc merged 4 commits intomainfrom
paullgdc/ci/relax_pr_title_semver_check
Mar 12, 2026
Merged

ci: relax pr title semver check#1710
paullegranddc merged 4 commits intomainfrom
paullgdc/ci/relax_pr_title_semver_check

Conversation

@paullegranddc
Copy link
Contributor

@paullegranddc paullegranddc commented Mar 11, 2026

What does this PR do?

  • breaking changes markers are only for major changes (as spec-ed in conventional commits https://www.conventionalcommits.org/en/v1.0.0/#summary)
  • a pr can be marked as a breaking change even if the API stays stable
  • ci|docs|style|test|build|chore changes should not touch the public API
  • other types can do whatever
  • a PR label "skip-pr-title-semver-check" has been added to break glass on this check

# What does this PR do?

* breaking changes markers are only for major changes (as spec-ed in conventional commits https://www.conventionalcommits.org/en/v1.0.0/#summary)
* a pr can be marked as a breaking change even if the API stays stable
* ci|docs|style|test|build|chore changes should not touch the public API
* other types can do whatever
* a PR label "skip-pr-title-semver-check" has been added to break glass on this check
@paullegranddc paullegranddc force-pushed the paullgdc/ci/relax_pr_title_semver_check branch from 95eec88 to d39462f Compare March 11, 2026 14:09
@codecov-commenter
Copy link

codecov-commenter commented Mar 11, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.25%. Comparing base (001bd56) to head (3500175).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #1710   +/-   ##
=======================================
  Coverage   71.25%   71.25%           
=======================================
  Files         429      429           
  Lines       63547    63547           
=======================================
+ Hits        45279    45283    +4     
+ Misses      18268    18264    -4     
Components Coverage Δ
libdd-crashtracker 62.42% <ø> (ø)
libdd-crashtracker-ffi 17.18% <ø> (ø)
libdd-alloc 98.77% <ø> (ø)
libdd-data-pipeline 88.32% <ø> (ø)
libdd-data-pipeline-ffi 76.94% <ø> (ø)
libdd-common 79.73% <ø> (ø)
libdd-common-ffi 73.40% <ø> (ø)
libdd-telemetry 62.48% <ø> (ø)
libdd-telemetry-ffi 16.75% <ø> (ø)
libdd-dogstatsd-client 82.64% <ø> (ø)
datadog-ipc 80.47% <ø> (ø)
libdd-profiling 81.59% <ø> (-0.02%) ⬇️
libdd-profiling-ffi 63.65% <ø> (ø)
datadog-sidecar 32.61% <ø> (ø)
datdog-sidecar-ffi 8.35% <ø> (ø)
spawn-worker 54.69% <ø> (ø)
libdd-tinybytes 93.16% <ø> (ø)
libdd-trace-normalization 81.71% <ø> (ø)
libdd-trace-obfuscation 91.80% <ø> (ø)
libdd-trace-protobuf 68.25% <ø> (ø)
libdd-trace-utils 89.08% <ø> (ø)
datadog-tracer-flare 88.95% <ø> (ø)
libdd-log 74.69% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@pr-commenter
Copy link

pr-commenter bot commented Mar 11, 2026

Benchmarks

Comparison

Benchmark execution time: 2026-03-12 11:10:12

Comparing candidate commit 3500175 in PR branch paullgdc/ci/relax_pr_title_semver_check with baseline commit bc8f764 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 2 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 13.889ms 13.935ms ± 0.029ms 13.930ms ± 0.012ms 13.944ms 13.980ms 14.047ms 14.101ms 1.23% 2.510 9.135 0.20% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [13.931ms; 13.939ms] or [-0.028%; +0.028%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.739µs 146.381µs ± 1.848µs 146.102µs ± 0.573µs 146.672µs 148.198µs 153.640µs 164.293µs 12.45% 6.114 49.608 1.26% 0.131µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.125µs; 146.637µs] or [-0.175%; +0.175%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 88.973µs 89.281µs ± 0.177µs 89.280µs ± 0.112µs 89.376µs 89.514µs 89.654µs 90.679µs 1.57% 2.636 18.211 0.20% 0.013µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [89.257µs; 89.306µs] or [-0.027%; +0.027%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.498µs 33.862µs ± 0.430µs 33.673µs ± 0.128µs 34.211µs 34.337µs 35.272µs 36.887µs 9.55% 2.719 12.525 1.27% 0.030µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.803µs; 33.922µs] or [-0.176%; +0.176%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 726.003µs 727.976µs ± 0.740µs 727.867µs ± 0.443µs 728.360µs 729.292µs 730.171µs 731.489µs 0.50% 1.052 2.544 0.10% 0.052µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [727.873µs; 728.079µs] or [-0.014%; +0.014%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 248.890ns 263.706ns ± 19.532ns 255.039ns ± 4.667ns 265.548ns 304.961ns 321.284ns 322.978ns 26.64% 1.566 1.241 7.39% 1.381ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [260.999ns; 266.412ns] or [-1.027%; +1.027%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.377µs 2.427µs ± 0.046µs 2.419µs ± 0.012µs 2.430µs 2.511µs 2.712µs 2.712µs 12.14% 3.998 20.769 1.88% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.421µs; 2.434µs] or [-0.261%; +0.261%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.955µs 5.036µs ± 0.060µs 4.997µs ± 0.021µs 5.077µs 5.157µs 5.161µs 5.164µs 3.34% 0.797 -0.710 1.20% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.027µs; 5.044µs] or [-0.166%; +0.166%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 493.088µs 494.055µs ± 0.432µs 494.001µs ± 0.304µs 494.331µs 494.772µs 495.072µs 495.979µs 0.40% 0.618 1.098 0.09% 0.031µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 2016213.493op/s 2024068.769op/s ± 1767.596op/s 2024288.652op/s ± 1244.347op/s 2025408.126op/s 2026691.197op/s 2027446.670op/s 2028035.335op/s 0.19% -0.611 1.073 0.09% 124.988op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 370.491µs 371.313µs ± 0.388µs 371.288µs ± 0.300µs 371.596µs 372.005µs 372.202µs 372.350µs 0.29% 0.400 -0.576 0.10% 0.027µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2685641.777op/s 2693149.706op/s ± 2814.883op/s 2693327.646op/s ± 2177.598op/s 2695423.634op/s 2697085.080op/s 2697923.308op/s 2699124.064op/s 0.22% -0.396 -0.581 0.10% 199.042op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 167.301µs 167.586µs ± 0.132µs 167.568µs ± 0.073µs 167.655µs 167.793µs 168.073µs 168.209µs 0.38% 1.289 3.621 0.08% 0.009µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5944972.779op/s 5967087.268op/s ± 4710.391op/s 5967726.535op/s ± 2600.217op/s 5969837.811op/s 5973242.070op/s 5975313.546op/s 5977233.967op/s 0.16% -1.280 3.583 0.08% 333.075op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.940µs 37.097µs ± 0.054µs 37.093µs ± 0.027µs 37.120µs 37.181µs 37.284µs 37.320µs 0.61% 1.076 3.364 0.14% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26795457.193op/s 26956750.403op/s ± 38915.498op/s 26959463.355op/s ± 19402.612op/s 26977529.266op/s 27009705.220op/s 27033820.121op/s 27070839.610op/s 0.41% -1.058 3.316 0.14% 2751.741op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.376µs 45.636µs ± 0.105µs 45.648µs ± 0.079µs 45.718µs 45.775µs 45.820µs 46.051µs 0.88% -0.049 0.213 0.23% 0.007µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21714866.432op/s 21912664.462op/s ± 50325.979op/s 21906874.122op/s ± 38004.239op/s 21951737.520op/s 21990834.131op/s 22026701.926op/s 22038081.805op/s 0.60% 0.065 0.184 0.23% 3558.584op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [493.995µs; 494.115µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2023823.797op/s; 2024313.741op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [371.259µs; 371.367µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2692759.590op/s; 2693539.821op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [167.568µs; 167.604µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5966434.453op/s; 5967740.083op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.089µs; 37.104µs] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26951357.089op/s; 26962143.717op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.621µs; 45.650µs] or [-0.032%; +0.032%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21905689.766op/s; 21919639.159op/s] or [-0.032%; +0.032%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.152ms 4.160ms ± 0.007ms 4.159ms ± 0.001ms 4.160ms 4.163ms 4.166ms 4.248ms 2.15% 11.232 143.870 0.16% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.159ms; 4.160ms] or [-0.023%; +0.023%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 48.853ms 49.248ms ± 1.207ms 49.079ms ± 0.086ms 49.168ms 49.394ms 58.686ms 59.167ms 20.55% 7.774 59.513 2.45% 0.085ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [49.081ms; 49.416ms] or [-0.340%; +0.340%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.637ms 10.664ms ± 0.014ms 10.661ms ± 0.008ms 10.671ms 10.688ms 10.712ms 10.715ms 0.50% 1.061 1.764 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.662ms; 10.666ms] or [-0.018%; +0.018%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2598 execution_time 3.574ms 3.606ms ± 0.016ms 3.603ms ± 0.009ms 3.615ms 3.638ms 3.653ms 3.663ms 1.67% 0.881 0.685 0.45% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2598 execution_time [3.604ms; 3.609ms] or [-0.063%; +0.063%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 165.204µs 165.865µs ± 0.243µs 165.820µs ± 0.129µs 165.989µs 166.346µs 166.476µs 166.698µs 0.53% 0.576 0.798 0.15% 0.017µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [165.831µs; 165.899µs] or [-0.020%; +0.020%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 205.937µs 206.500µs ± 0.301µs 206.442µs ± 0.171µs 206.666µs 207.047µs 207.345µs 207.503µs 0.51% 0.697 0.249 0.15% 0.021µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4819201.784op/s 4842631.529op/s ± 7052.432op/s 4843976.816op/s ± 4009.527op/s 4847516.140op/s 4852903.765op/s 4854687.705op/s 4855846.327op/s 0.25% -0.689 0.234 0.15% 498.682op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.569µs 18.668µs ± 0.081µs 18.657µs ± 0.032µs 18.683µs 18.837µs 18.996µs 19.051µs 2.11% 1.931 5.070 0.43% 0.006µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52491920.470op/s 53568325.278op/s ± 230692.815op/s 53600293.092op/s ± 91244.440op/s 53709604.006op/s 53838066.730op/s 53853177.017op/s 53854105.577op/s 0.47% -1.888 4.860 0.43% 16312.445op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.741µs 10.832µs ± 0.044µs 10.826µs ± 0.028µs 10.859µs 10.913µs 10.944µs 10.999µs 1.60% 0.696 0.548 0.41% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 90914642.948op/s 92318582.168op/s ± 376531.486op/s 92370154.941op/s ± 241234.934op/s 92576855.574op/s 92899651.286op/s 92941187.795op/s 93098289.763op/s 0.79% -0.671 0.492 0.41% 26624.797op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [206.458µs; 206.541µs] or [-0.020%; +0.020%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4841654.130op/s; 4843608.928op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.657µs; 18.679µs] or [-0.060%; +0.060%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53536353.472op/s; 53600297.083op/s] or [-0.060%; +0.060%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.826µs; 10.838µs] or [-0.057%; +0.057%] None None None
normalization/normalize_name/normalize_name/good throughput [92266398.525op/s; 92370765.811op/s] or [-0.057%; +0.057%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.191µs 3.149µs ± 1.399µs 2.984µs ± 0.029µs 3.009µs 3.353µs 13.546µs 14.923µs 400.05% 7.511 57.050 44.32% 0.099µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.955µs; 3.343µs] or [-6.158%; +6.158%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.897µs 3.914µs ± 0.003µs 3.914µs ± 0.002µs 3.916µs 3.919µs 3.923µs 3.925µs 0.29% -0.023 4.179 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 254778975.499op/s 255496378.339op/s ± 206823.464op/s 255506221.582op/s ± 130155.585op/s 255644170.586op/s 255745660.330op/s 255832248.062op/s 256599193.967op/s 0.43% 0.038 4.225 0.08% 14624.627op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 79.579µs 80.146µs ± 0.139µs 80.153µs ± 0.083µs 80.230µs 80.307µs 80.392µs 81.217µs 1.33% 1.872 17.387 0.17% 0.010µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12312670.112op/s 12477259.418op/s ± 21524.189op/s 12476164.912op/s ± 12867.220op/s 12489905.658op/s 12504903.317op/s 12515941.029op/s 12566079.988op/s 0.72% -1.791 16.761 0.17% 1521.990op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 67.780µs 67.884µs ± 0.064µs 67.874µs ± 0.029µs 67.909µs 67.960µs 67.995µs 68.554µs 1.00% 5.735 56.964 0.09% 0.005µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 14586987.678op/s 14731117.448op/s ± 13900.697op/s 14733088.945op/s ± 6318.090op/s 14738832.372op/s 14745936.604op/s 14751060.746op/s 14753539.628op/s 0.14% -5.661 55.948 0.09% 982.928op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.895µs 3.914µs ± 0.003µs 3.913µs ± 0.002µs 3.916µs 3.919µs 3.923µs 3.924µs 0.27% -0.473 6.921 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254840218.674op/s 255497725.826op/s ± 202864.564op/s 255527162.539op/s ± 122691.440op/s 255625275.561op/s 255739000.885op/s 255793528.008op/s 256752515.798op/s 0.48% 0.494 7.030 0.08% 14344.691op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 64.574µs 64.674µs ± 0.054µs 64.662µs ± 0.037µs 64.713µs 64.773µs 64.813µs 64.856µs 0.30% 0.647 0.074 0.08% 0.004µs 1 200
credit_card/is_card_number/378282246310005 throughput 15418829.116op/s 15462186.786op/s ± 12869.146op/s 15464919.377op/s ± 8812.008op/s 15472244.341op/s 15478920.576op/s 15484099.287op/s 15486223.456op/s 0.14% -0.643 0.065 0.08% 909.986op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.376µs 45.682µs ± 0.109µs 45.676µs ± 0.075µs 45.762µs 45.855µs 45.907µs 45.961µs 0.62% 0.050 -0.369 0.24% 0.008µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21757464.673op/s 21890699.661op/s ± 52069.773op/s 21893191.218op/s ± 35978.672op/s 21928350.624op/s 21972018.240op/s 22004738.708op/s 22038243.699op/s 0.66% -0.039 -0.366 0.24% 3681.889op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.556µs 6.625µs ± 0.014µs 6.631µs ± 0.006µs 6.635µs 6.640µs 6.644µs 6.649µs 0.27% -1.574 3.371 0.22% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 150401911.758op/s 150937757.758op/s ± 327516.522op/s 150805513.738op/s ± 138112.027op/s 151155232.664op/s 151583069.615op/s 151823259.826op/s 152537162.750op/s 1.15% 1.593 3.476 0.22% 23158.915op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.899µs 3.914µs ± 0.003µs 3.913µs ± 0.002µs 3.916µs 3.918µs 3.921µs 3.922µs 0.22% -0.361 2.655 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254983764.503op/s 255519329.309op/s ± 188652.062op/s 255540841.336op/s ± 126599.689op/s 255638830.578op/s 255782148.764op/s 255874231.674op/s 256489078.275op/s 0.37% 0.371 2.694 0.07% 13339.715op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.568µs 65.680µs ± 0.059µs 65.670µs ± 0.037µs 65.716µs 65.794µs 65.847µs 65.872µs 0.31% 0.691 0.363 0.09% 0.004µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15180893.744op/s 15225445.267op/s ± 13555.893op/s 15227610.225op/s ± 8613.838op/s 15235121.615op/s 15244586.849op/s 15248574.673op/s 15251404.450op/s 0.16% -0.686 0.353 0.09% 958.546op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.339µs 53.411µs ± 0.037µs 53.405µs ± 0.024µs 53.431µs 53.468µs 53.537µs 53.581µs 0.33% 1.143 2.325 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18663396.998op/s 18722737.711op/s ± 12958.078op/s 18724869.275op/s ± 8311.343op/s 18732314.061op/s 18738216.727op/s 18743527.294op/s 18748135.159op/s 0.12% -1.137 2.298 0.07% 916.274op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.894µs 3.914µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.918µs 3.921µs 3.923µs 0.24% -1.027 10.503 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254927374.123op/s 255525693.097op/s ± 189223.562op/s 255544189.150op/s ± 110997.141op/s 255638780.406op/s 255764185.261op/s 255826066.335op/s 256828048.999op/s 0.50% 1.053 10.673 0.07% 13380.126op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.126µs 50.214µs ± 0.038µs 50.222µs ± 0.027µs 50.239µs 50.273µs 50.311µs 50.323µs 0.20% 0.077 -0.354 0.08% 0.003µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19871714.175op/s 19914866.906op/s ± 15010.749op/s 19911445.836op/s ± 10759.113op/s 19927994.676op/s 19939516.368op/s 19942963.324op/s 19949625.201op/s 0.19% -0.073 -0.359 0.08% 1061.420op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.404µs 45.699µs ± 0.111µs 45.703µs ± 0.076µs 45.786µs 45.865µs 45.936µs 45.944µs 0.53% -0.194 -0.366 0.24% 0.008µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21765629.884op/s 21882610.712op/s ± 53361.740op/s 21880608.313op/s ± 36496.892op/s 21916814.032op/s 21977940.054op/s 22008301.070op/s 22024730.454op/s 0.66% 0.205 -0.359 0.24% 3773.245op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.575µs 6.622µs ± 0.015µs 6.625µs ± 0.010µs 6.633µs 6.640µs 6.642µs 6.647µs 0.33% -0.851 0.335 0.22% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 150450209.798op/s 151020803.230op/s ± 337127.817op/s 150947327.259op/s ± 218576.969op/s 151237117.120op/s 151679694.003op/s 152030077.076op/s 152102453.795op/s 0.77% 0.861 0.364 0.22% 23838.537op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.914µs; 3.914µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ throughput [255467714.596op/s; 255525042.082op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [80.127µs; 80.165µs] or [-0.024%; +0.024%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12474276.372op/s; 12480242.463op/s] or [-0.024%; +0.024%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [67.875µs; 67.892µs] or [-0.013%; +0.013%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14729190.945op/s; 14733043.951op/s] or [-0.013%; +0.013%] None None None
credit_card/is_card_number/37828224631 execution_time [3.914µs; 3.914µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255469610.749op/s; 255525840.904op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [64.666µs; 64.681µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/378282246310005 throughput [15460403.247op/s; 15463970.326op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.667µs; 45.697µs] or [-0.033%; +0.033%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21883483.291op/s; 21897916.031op/s] or [-0.033%; +0.033%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.623µs; 6.627µs] or [-0.030%; +0.030%] None None None
credit_card/is_card_number/x371413321323331 throughput [150892367.118op/s; 150983148.398op/s] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.913µs; 3.914µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255493183.947op/s; 255545474.670op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.671µs; 65.688µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15223566.550op/s; 15227323.983op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.406µs; 53.416µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18720941.846op/s; 18724533.576op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.913µs; 3.914µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255499468.531op/s; 255551917.663op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.209µs; 50.219µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19912786.561op/s; 19916947.252op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.683µs; 45.714µs] or [-0.034%; +0.034%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21875215.288op/s; 21890006.136op/s] or [-0.034%; +0.034%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.620µs; 6.624µs] or [-0.031%; +0.031%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [150974080.557op/s; 151067525.903op/s] or [-0.031%; +0.031%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 190.422ns 192.667ns ± 1.893ns 192.416ns ± 1.383ns 193.706ns 196.398ns 197.905ns 201.156ns 4.54% 1.108 1.722 0.98% 0.134ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [192.404ns; 192.929ns] or [-0.136%; +0.136%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3500175 1773312701 paullgdc/ci/relax_pr_title_semver_check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.289µs 26.520µs ± 9.980µs 18.513µs ± 0.157µs 35.371µs 44.489µs 45.093µs 72.620µs 292.27% 0.902 0.607 37.54% 0.706µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [25.137µs; 27.903µs] or [-5.215%; +5.215%] None None None

Baseline

Omitted due to size.

@dd-octo-sts
Copy link
Contributor

dd-octo-sts bot commented Mar 11, 2026

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 100.29 MB 100.29 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.63 MB 8.63 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.21 MB 11.21 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 116.96 MB 116.96 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 27.17 MB 27.17 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 76.61 KB 76.61 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 186.05 MB 186.06 MB +0% (+16.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 917.15 MB 917.15 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.94 MB 9.94 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 76.61 KB 76.61 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 24.77 MB 24.77 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 51.44 MB 51.44 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 22.97 MB 22.97 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 77.80 KB 77.80 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 190.23 MB 190.23 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 900.81 MB 900.81 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.53 MB 7.53 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 77.80 KB 77.80 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 26.52 MB 26.52 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 47.06 MB 47.06 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 87.50 MB 87.50 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 10.21 MB 10.21 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 109.83 MB 109.83 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.95 MB 11.95 MB 0% (0 B) 👌

@paullegranddc paullegranddc marked this pull request as ready for review March 11, 2026 20:02
@paullegranddc paullegranddc requested a review from a team as a code owner March 11, 2026 20:02
Copy link
Contributor

@VianneyRuhlmann VianneyRuhlmann left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Co-authored-by: vianney <vianney.ruhlmann@datadoghq.com>
@paullegranddc
Copy link
Contributor Author

/merge

@gh-worker-devflow-routing-ef8351
Copy link

gh-worker-devflow-routing-ef8351 bot commented Mar 12, 2026

View all feedbacks in Devflow UI.

2026-03-12 12:04:12 UTC ℹ️ Start processing command /merge


2026-03-12 12:04:18 UTC ℹ️ MergeQueue: waiting for PR to be ready

This pull request is not mergeable according to GitHub. Common reasons include pending required checks, missing approvals, or merge conflicts — but it could also be blocked by other repository rules or settings.
It will be added to the queue as soon as checks pass and/or get approvals. View in MergeQueue UI.
Note: if you pushed new commits since the last approval, you may need additional approval.
You can remove it from the waiting list with /remove command.


2026-03-12 12:32:12 UTC ℹ️ MergeQueue: merge request added to the queue

The expected merge time in main is approximately 46m (p90).


2026-03-12 13:07:30 UTC ℹ️ MergeQueue: This merge request was already merged

This pull request was merged directly.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants