Skip to content

ci: add script to add file attribute to junit.xml #1487

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
ekump wants to merge 3 commits into
base: main
Choose a base branch
from
Open

ci: add script to add file attribute to junit.xml #1487

ekump wants to merge 3 commits into from

Conversation

@ekump
Copy link
Contributor

@ekump ekump commented Jan 28, 2026 •
edited
Loading

What does this PR do?

cargo-nextest does not include the file path for test cases when generating junit.xml. This script runs after the junit.xml is generated by nextest and uses cargo-metadata to resolve the filename for tests.

Motivation

The Test Optimization tool uses the file attribute and the git CODEOWNERS file to map test failures to code owners to provide granular alerting capabilities.

Additional Notes

Comments in the code explain this but two things make this less trivial than expected:

  1. Unit tests and integration tests are reported differently in the junit.xml file.
  2. Some crates don't match on their package name and the target name. For example, libdd-profiling-ffi has a lib target of datadog_profiling_ffi. For unit tests we need to include a fallback to check the alias if it exists to properly resolve to the file name.

How to test the change?

Generate the Junit file locally with cargo nextest run --profile ci --workspace to target/nextest/ci/junit.xml
Run the script to add file attributes with cargo run --bin add_junit_file_attributes -- target/nextest/ci/junit.xml -o junit_with_files.xml

I verified all tests have codeowners in Test Optimization on my branch

@pr-commenter
Copy link

pr-commenter bot commented Jan 28, 2026 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-01-30 22:47:34

Comparing candidate commit 06d7e4f in PR branch ekump/APMSP-2547-add-file-attribute-to-junit with baseline commit c9d6835 in branch main.

Found 2 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 2 unstable metrics.

scenario:normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて

  • 🟩 execution_time [-23.613µs; -23.412µs] or [-5.823%; -5.774%]
  • 🟩 throughput [+151139.499op/s; +152493.669op/s] or [+6.128%; +6.183%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.378µs 161.331µs ± 0.322µs 161.331µs ± 0.170µs 161.480µs 161.793µs 162.100µs 164.011µs 1.66% 2.864 22.946 0.20% 0.023µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.286µs; 161.376µs] or [-0.028%; +0.028%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.943µs 25.839µs ± 10.015µs 18.231µs ± 0.199µs 34.752µs 44.098µs 49.338µs 72.823µs 299.44% 1.175 1.610 38.66% 0.708µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.451µs; 27.227µs] or [-5.372%; +5.372%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.223µs 3.185µs ± 1.412µs 2.981µs ± 0.022µs 3.005µs 3.659µs 13.843µs 14.765µs 395.33% 7.371 55.414 44.22% 0.100µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.989µs; 3.381µs] or [-6.144%; +6.144%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 535.158µs 536.566µs ± 1.139µs 536.229µs ± 0.493µs 537.013µs 538.882µs 539.880µs 541.618µs 1.00% 1.422 1.870 0.21% 0.081µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1846320.733op/s 1863711.084op/s ± 3945.238op/s 1864873.772op/s ± 1714.425op/s 1866366.767op/s 1867960.980op/s 1868284.117op/s 1868607.850op/s 0.20% -1.410 1.816 0.21% 278.970op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.318µs 381.967µs ± 0.663µs 382.142µs ± 0.282µs 382.419µs 382.708µs 383.030µs 383.314µs 0.31% -0.990 0.023 0.17% 0.047µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2608829.595op/s 2618033.261op/s ± 4550.257op/s 2616826.662op/s ± 1927.964op/s 2618807.320op/s 2627282.574op/s 2628733.434op/s 2629377.671op/s 0.48% 0.996 0.029 0.17% 321.752op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.246µs 189.938µs ± 0.442µs 189.912µs ± 0.129µs 190.044µs 190.261µs 190.739µs 194.123µs 2.22% 6.350 53.999 0.23% 0.031µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5151378.542op/s 5264899.137op/s ± 12086.279op/s 5265589.588op/s ± 3585.287op/s 5268929.363op/s 5275891.527op/s 5280918.862op/s 5284138.993op/s 0.35% -6.241 52.727 0.23% 854.629op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.485µs 36.583µs ± 0.059µs 36.573µs ± 0.032µs 36.609µs 36.712µs 36.762µs 36.775µs 0.55% 1.021 0.859 0.16% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 27192200.170op/s 27335056.819op/s ± 43732.896op/s 27342512.464op/s ± 24174.553op/s 27364341.591op/s 27390911.678op/s 27401088.113op/s 27408321.626op/s 0.24% -1.012 0.838 0.16% 3092.383op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.928µs 46.059µs ± 0.120µs 46.043µs ± 0.046µs 46.092µs 46.184µs 46.254µs 47.424µs 3.00% 7.584 83.262 0.26% 0.008µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21086213.676op/s 21711562.281op/s ± 55296.298op/s 21718710.126op/s ± 21909.006op/s 21739757.640op/s 21758894.345op/s 21769596.646op/s 21773411.977op/s 0.25% -7.371 79.978 0.25% 3910.039op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [536.408µs; 536.724µs] or [-0.029%; +0.029%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1863164.312op/s; 1864257.856op/s] or [-0.029%; +0.029%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.875µs; 382.059µs] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2617402.639op/s; 2618663.883op/s] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [189.877µs; 189.999µs] or [-0.032%; +0.032%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5263224.095op/s; 5266574.179op/s] or [-0.032%; +0.032%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.575µs; 36.591µs] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27328995.860op/s; 27341117.777op/s] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [46.042µs; 46.075µs] or [-0.036%; +0.036%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21703898.746op/s; 21719225.816op/s] or [-0.035%; +0.035%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 205.968µs 206.531µs ± 0.302µs 206.517µs ± 0.200µs 206.699µs 207.045µs 207.475µs 207.622µs 0.54% 0.719 0.679 0.15% 0.021µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4816437.120op/s 4841904.295op/s ± 7073.965op/s 4842210.993op/s ± 4685.693op/s 4847078.285op/s 4852036.492op/s 4853935.307op/s 4855118.029op/s 0.27% -0.709 0.654 0.15% 500.205op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.560µs 18.644µs ± 0.055µs 18.633µs ± 0.022µs 18.661µs 18.733µs 18.864µs 19.011µs 2.03% 2.724 12.256 0.29% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52602368.444op/s 53638374.877op/s ± 156752.786op/s 53668357.328op/s ± 63815.297op/s 53725682.584op/s 53805098.874op/s 53869369.968op/s 53880269.821op/s 0.39% -2.665 11.781 0.29% 11084.096op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.666µs 10.753µs ± 0.036µs 10.750µs ± 0.021µs 10.771µs 10.825µs 10.851µs 10.884µs 1.25% 0.632 0.802 0.33% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 91878308.233op/s 93001232.080op/s ± 309962.428op/s 93027549.684op/s ± 180653.825op/s 93196893.717op/s 93472304.541op/s 93600670.895op/s 93755859.741op/s 0.78% -0.608 0.758 0.33% 21917.653op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [206.489µs; 206.573µs] or [-0.020%; +0.020%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4840923.911op/s; 4842884.678op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.636µs; 18.651µs] or [-0.041%; +0.041%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53616650.449op/s; 53660099.306op/s] or [-0.041%; +0.041%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.748µs; 10.758µs] or [-0.046%; +0.046%] None None None
normalization/normalize_name/normalize_name/good throughput [92958274.269op/s; 93044189.892op/s] or [-0.046%; +0.046%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.640ms 10.670ms ± 0.016ms 10.667ms ± 0.009ms 10.678ms 10.699ms 10.723ms 10.748ms 0.75% 1.357 3.789 0.15% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.668ms; 10.672ms] or [-0.021%; +0.021%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 49.635ms 49.959ms ± 1.386ms 49.769ms ± 0.060ms 49.838ms 49.996ms 60.250ms 62.269ms 25.12% 7.980 62.481 2.77% 0.098ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [49.767ms; 50.151ms] or [-0.384%; +0.384%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.893µs 3.914µs ± 0.004µs 3.914µs ± 0.002µs 3.916µs 3.919µs 3.921µs 3.950µs 0.92% 2.472 25.703 0.11% 0.000µs 1 200
credit_card/is_card_number/ throughput 253149643.912op/s 255504168.759op/s ± 281476.635op/s 255483630.928op/s ± 153215.341op/s 255677404.510op/s 255859125.250op/s 255942890.885op/s 256840732.429op/s 0.53% -2.401 25.142 0.11% 19903.404op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.060µs 77.608µs ± 0.326µs 77.574µs ± 0.215µs 77.854µs 78.206µs 78.449µs 78.679µs 1.42% 0.567 -0.098 0.42% 0.023µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12709951.902op/s 12885555.272op/s ± 54062.884op/s 12890960.214op/s ± 35697.176op/s 12923518.546op/s 12960944.265op/s 12972546.709op/s 12976847.594op/s 0.67% -0.547 -0.136 0.42% 3822.823op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 70.639µs 71.099µs ± 0.295µs 71.050µs ± 0.177µs 71.290µs 71.575µs 71.919µs 72.201µs 1.62% 0.675 0.467 0.41% 0.021µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13850237.286op/s 14065230.636op/s ± 58186.613op/s 14074631.199op/s ± 35006.390op/s 14103747.366op/s 14146672.210op/s 14153271.016op/s 14156458.789op/s 0.58% -0.650 0.396 0.41% 4114.415op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.895µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.915µs 3.918µs 3.919µs 3.920µs 0.20% -0.487 3.183 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255097027.157op/s 255593670.181op/s ± 211193.689op/s 255600418.078op/s ± 145290.082op/s 255733481.906op/s 255888066.220op/s 255958020.564op/s 256740956.207op/s 0.45% 0.499 3.244 0.08% 14933.649op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 67.392µs 67.855µs ± 0.305µs 67.773µs ± 0.217µs 68.042µs 68.465µs 68.676µs 68.801µs 1.52% 0.821 0.163 0.45% 0.022µs 1 200
credit_card/is_card_number/378282246310005 throughput 14534659.614op/s 14737631.412op/s ± 65902.314op/s 14755190.700op/s ± 47200.552op/s 14786980.126op/s 14819185.751op/s 14831683.221op/s 14838553.530op/s 0.56% -0.801 0.119 0.45% 4659.997op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 44.623µs 45.193µs ± 0.187µs 45.210µs ± 0.128µs 45.333µs 45.453µs 45.518µs 45.526µs 0.70% -0.607 0.238 0.41% 0.013µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21965420.294op/s 22127814.550op/s ± 92013.584op/s 22118895.555op/s ± 62606.107op/s 22182754.739op/s 22301891.658op/s 22389496.191op/s 22409832.223op/s 1.32% 0.630 0.283 0.41% 6506.343op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.027µs 6.036µs ± 0.010µs 6.035µs ± 0.003µs 6.037µs 6.042µs 6.093µs 6.105µs 1.16% 5.272 32.073 0.16% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 163810128.630op/s 165675836.937op/s ± 259040.207op/s 165702603.052op/s ± 80523.131op/s 165788688.251op/s 165877935.115op/s 165906116.038op/s 165924016.419op/s 0.13% -5.242 31.798 0.16% 18316.909op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.892µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.917µs 3.918µs 3.920µs 0.17% -1.691 11.427 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255128879.012op/s 255571326.807op/s ± 187066.084op/s 255573637.580op/s ± 121620.926op/s 255685929.649op/s 255806983.674op/s 255892821.263op/s 256911507.555op/s 0.52% 1.714 11.625 0.07% 13227.570op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.021µs 65.726µs ± 0.098µs 65.731µs ± 0.059µs 65.791µs 65.857µs 65.885µs 65.915µs 0.28% -2.032 12.330 0.15% 0.007µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15171025.048op/s 15214772.282op/s ± 22650.448op/s 15213452.192op/s ± 13747.444op/s 15227025.622op/s 15247537.266op/s 15267282.073op/s 15379748.610op/s 1.09% 2.078 12.739 0.15% 1601.629op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 52.942µs 53.024µs ± 0.038µs 53.025µs ± 0.026µs 53.049µs 53.087µs 53.110µs 53.141µs 0.22% 0.134 -0.213 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18817989.321op/s 18859514.771op/s ± 13394.637op/s 18859002.418op/s ± 9311.186op/s 18868921.000op/s 18882151.647op/s 18886009.190op/s 18888629.045op/s 0.16% -0.130 -0.216 0.07% 947.144op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.913µs ± 0.003µs 3.912µs ± 0.002µs 3.915µs 3.917µs 3.918µs 3.934µs 0.55% 0.644 9.737 0.09% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254209695.659op/s 255588711.850op/s ± 222990.993op/s 255602704.850op/s ± 141012.289op/s 255726665.903op/s 255861320.588op/s 255932899.837op/s 256764287.974op/s 0.45% -0.615 9.671 0.09% 15767.844op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 49.734µs 49.809µs ± 0.037µs 49.809µs ± 0.028µs 49.833µs 49.871µs 49.882µs 49.896µs 0.17% 0.065 -0.747 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 20041552.820op/s 20076902.250op/s ± 14817.749op/s 20076577.664op/s ± 11461.918op/s 20088414.509op/s 20100876.398op/s 20105564.316op/s 20106886.609op/s 0.15% -0.063 -0.747 0.07% 1047.773op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 44.676µs 45.217µs ± 0.180µs 45.225µs ± 0.127µs 45.359µs 45.471µs 45.522µs 45.547µs 0.71% -0.463 -0.335 0.40% 0.013µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21955444.886op/s 22115924.638op/s ± 88205.740op/s 22111799.362op/s ± 62116.368op/s 22170151.221op/s 22274593.486op/s 22325051.575op/s 22383481.878op/s 1.23% 0.480 -0.308 0.40% 6237.088op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.027µs 6.036µs ± 0.005µs 6.036µs ± 0.003µs 6.039µs 6.044µs 6.048µs 6.076µs 0.66% 2.147 13.786 0.09% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 164591171.334op/s 165665743.141op/s ± 145212.351op/s 165673434.750op/s ± 93718.265op/s 165757278.802op/s 165871861.493op/s 165895822.112op/s 165915122.592op/s 0.15% -2.118 13.518 0.09% 10268.064op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.913µs; 3.914µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/ throughput [255465158.805op/s; 255543178.714op/s] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [77.562µs; 77.653µs] or [-0.058%; +0.058%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12878062.676op/s; 12893047.867op/s] or [-0.058%; +0.058%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.058µs; 71.139µs] or [-0.057%; +0.057%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14057166.531op/s; 14073294.740op/s] or [-0.057%; +0.057%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255564400.767op/s; 255622939.595op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [67.813µs; 67.897µs] or [-0.062%; +0.062%] None None None
credit_card/is_card_number/378282246310005 throughput [14728497.985op/s; 14746764.839op/s] or [-0.062%; +0.062%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.167µs; 45.219µs] or [-0.057%; +0.057%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [22115062.352op/s; 22140566.748op/s] or [-0.058%; +0.058%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.035µs; 6.037µs] or [-0.022%; +0.022%] None None None
credit_card/is_card_number/x371413321323331 throughput [165639936.456op/s; 165711737.419op/s] or [-0.022%; +0.022%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255545401.247op/s; 255597252.367op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.712µs; 65.739µs] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15211633.147op/s; 15217911.416op/s] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.018µs; 53.029µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18857658.403op/s; 18861371.138op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.913µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255557807.443op/s; 255619616.257op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [49.803µs; 49.814µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [20074848.652op/s; 20078955.847op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.192µs; 45.242µs] or [-0.055%; +0.055%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [22103700.171op/s; 22128149.105op/s] or [-0.055%; +0.055%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.036µs; 6.037µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165645618.106op/s; 165685868.176op/s] or [-0.012%; +0.012%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.241µs 146.169µs ± 1.899µs 145.845µs ± 0.487µs 146.394µs 147.775µs 153.115µs 165.584µs 13.53% 6.523 57.594 1.30% 0.134µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [145.906µs; 146.433µs] or [-0.180%; +0.180%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.870µs 34.538µs ± 0.997µs 34.074µs ± 0.094µs 34.264µs 36.641µs 36.690µs 37.928µs 11.31% 1.680 1.045 2.88% 0.071µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.400µs; 34.676µs] or [-0.400%; +0.400%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 3.969ms 3.975ms ± 0.007ms 3.974ms ± 0.002ms 3.976ms 3.979ms 3.982ms 4.062ms 2.21% 11.068 140.785 0.17% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [3.974ms; 3.976ms] or [-0.023%; +0.023%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 89.627µs 89.895µs ± 0.165µs 89.884µs ± 0.050µs 89.927µs 90.023µs 90.302µs 91.814µs 2.15% 8.331 91.967 0.18% 0.012µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [89.872µs; 89.918µs] or [-0.025%; +0.025%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 188.394ns 190.921ns ± 1.974ns 190.737ns ± 1.423ns 191.846ns 195.331ns 196.540ns 198.249ns 3.94% 1.133 1.500 1.03% 0.140ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [190.648ns; 191.195ns] or [-0.143%; +0.143%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 12.575ms 12.927ms ± 0.118ms 12.954ms ± 0.049ms 12.994ms 13.080ms 13.132ms 13.219ms 2.05% -1.111 1.289 0.91% 0.008ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [12.911ms; 12.944ms] or [-0.127%; +0.127%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.357µs 2.399µs ± 0.013µs 2.397µs ± 0.007µs 2.407µs 2.423µs 2.429µs 2.446µs 2.04% 0.227 1.090 0.56% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.398µs; 2.401µs] or [-0.078%; +0.078%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 240.661ns 252.905ns ± 13.946ns 246.923ns ± 3.977ns 254.171ns 287.573ns 290.139ns 290.562ns 17.67% 1.513 0.956 5.50% 0.986ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [250.972ns; 254.837ns] or [-0.764%; +0.764%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.005µs 5.057µs ± 0.035µs 5.054µs ± 0.033µs 5.075µs 5.115µs 5.118µs 5.119µs 1.28% 0.372 -1.137 0.70% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.052µs; 5.062µs] or [-0.097%; +0.097%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 550.079µs 551.101µs ± 0.408µs 551.101µs ± 0.254µs 551.347µs 551.666µs 552.042µs 553.528µs 0.44% 0.969 5.431 0.07% 0.029µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [551.044µs; 551.157µs] or [-0.010%; +0.010%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06d7e4f 1769812337 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.584ms 14.660ms ± 0.040ms 14.654ms ± 0.018ms 14.674ms 14.730ms 14.791ms 14.899ms 1.67% 2.185 8.644 0.27% 0.003ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.655ms; 14.666ms] or [-0.038%; +0.038%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Jan 28, 2026 •
edited
Loading

Codecov Report

❌ Patch coverage is 72.79152% with 77 lines in your changes missing coverage. Please review.
✅ Project coverage is 70.99%. Comparing base (c9d6835) to head (06d7e4f).

Additional details and impacted files 
@@           Coverage Diff            @@
##             main    #1487    +/-   ##
========================================
  Coverage   70.98%   70.99%            
========================================
  Files         422      424     +2     
  Lines       68791    69074   +283     
========================================
+ Hits        48831    49036   +205     
- Misses      19960    20038    +78
Components Coverage Δ
libdd-crashtracker 60.92% <ø> (+0.05%) ⬆️
libdd-crashtracker-ffi 16.21% <ø> (ø)
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 86.84% <ø> (ø)
libdd-data-pipeline-ffi 78.57% <ø> (ø)
libdd-common 80.97% <ø> (ø)
libdd-common-ffi 74.54% <ø> (ø)
libdd-telemetry 59.78% <ø> (ø)
libdd-telemetry-ffi 21.17% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.60% <ø> (ø)
libdd-profiling 81.51% <ø> (+0.01%) ⬆️
libdd-profiling-ffi 64.71% <ø> (ø)
datadog-sidecar 34.94% <ø> (ø)
datdog-sidecar-ffi 10.25% <ø> (ø)
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 93.43% <ø> (ø)
libdd-trace-normalization 82.33% <ø> (ø)
libdd-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 61.18% <ø> (ø)
libdd-trace-utils 89.45% <ø> (ø)
datadog-tracer-flare 63.49% <ø> (ø)
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@dd-octo-sts
Copy link

dd-octo-sts bot commented Jan 28, 2026 •
edited
Loading

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 91.81 MB 91.81 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.44 MB 8.44 MB 0% (0 B) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 62.80 MB 62.80 MB 0% (0 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 9.48 MB 9.48 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.76 MB 10.76 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 106.15 MB 106.15 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 25.26 MB 25.26 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 75.59 KB 75.59 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 167.23 MB 167.20 MB --.01% (-24.00 KB) 💪
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 847.79 MB 847.79 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.61 MB 9.61 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 75.59 KB 75.59 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 23.10 MB 23.10 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 48.39 MB 48.39 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 21.33 MB 21.33 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 76.76 KB 76.76 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 171.34 MB 171.33 MB -0% (-16.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 834.55 MB 834.55 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.27 MB 7.27 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 76.76 KB 76.76 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 24.71 MB 24.71 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 44.10 MB 44.10 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 80.27 MB 80.27 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 9.90 MB 9.90 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 64.68 MB 64.68 MB 0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 10.51 MB 10.51 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 100.11 MB 100.11 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.48 MB 11.48 MB 0% (0 B) 👌

@ekump ekump force-pushed the ekump/APMSP-2547-add-file-attribute-to-junit branch 2 times, most recently from 42d12e2 to 7dc428a Compare January 30, 2026 22:08
@ekump ekump changed the title WIP: add file attribute to junit.xml output ci: add script to add file attribute to junit.xml Jan 30, 2026
@ekump ekump force-pushed the ekump/APMSP-2547-add-file-attribute-to-junit branch from 7dc428a to 06d7e4f Compare January 30, 2026 22:32
@ekump ekump marked this pull request as ready for review January 30, 2026 22:32
@ekump ekump requested review from a team as code owners January 30, 2026 22:32
@ekump ekump added the run-macos-tests Run macos tests in gitlab label Jan 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

ci-build run-macos-tests Run macos tests in gitlab

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@ekump @codecov-commenter