Skip to content

Conversation

gleocadie
Copy link
Contributor

@gleocadie gleocadie commented Aug 26, 2025

What does this PR do?

This PR introduces a crash_test_app which does function calls, crashes. The crash tracker will collect the report and make sure that the crashing thread callstack contains certain frames.

Motivation

Stability and quality: We want to make sure that crash tracker, more specifically the unwinder, accurately collects stack frames.

Additional Notes

Currently, the test is enabled for:

  • x86_64/glibc
  • aarch64/glibc
  • aarch64/musl-libc

But disabled for:

  • x86_64 musl, due to missing CFI (unwinding information) in the libc library.
  • macosx: we need to investigate why the report contains messages like "resolve_names failed with failed to open proc maps file /proc/10282/maps: No such file or directory (os error 2)". It seems that the application already died when we resolve names/normalize ips.

Comment on lines +28 to +36
#[cfg(any(target_arch = "x86", target_arch = "x86_64"))]
{
std::arch::asm!("mov eax, [0]", options(nostack));
}

#[cfg(target_arch = "aarch64")]
{
std::arch::asm!("mov x0, #0", "ldr x1, [x0]", options(nostack));
}
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe reuse

let crashing_callstack = &crash_payload["error"]["stack"]["frames"];
assert!(
crashing_callstack.as_array().unwrap().len() >= expected_functions.len(),
"crashing thread callstacks ddddd",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

make it cleaner

@codecov-commenter
Copy link

codecov-commenter commented Aug 26, 2025

Codecov Report

❌ Patch coverage is 0% with 72 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.64%. Comparing base (aa11985) to head (b1013b6).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1189      +/-   ##
==========================================
- Coverage   71.72%   71.64%   -0.08%     
==========================================
  Files         349      350       +1     
  Lines       55114    55186      +72     
==========================================
+ Hits        39528    39536       +8     
- Misses      15586    15650      +64     
Components Coverage Δ
datadog-crashtracker 47.15% <ø> (+0.02%) ⬆️
datadog-crashtracker-ffi 5.93% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 90.44% <ø> (ø)
data-pipeline-ffi 88.56% <ø> (ø)
ddcommon 83.98% <ø> (ø)
ddcommon-ffi 70.64% <ø> (ø)
ddtelemetry 60.07% <ø> (ø)
ddtelemetry-ffi 21.32% <ø> (ø)
dogstatsd-client 83.26% <ø> (ø)
datadog-ipc 82.39% <ø> (ø)
datadog-profiling 77.14% <ø> (ø)
datadog-profiling-ffi 62.12% <ø> (ø)
datadog-sidecar 36.64% <ø> (ø)
datdog-sidecar-ffi 8.76% <ø> (ø)
spawn-worker 55.35% <ø> (ø)
tinybytes 92.22% <ø> (ø)
datadog-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
datadog-trace-protobuf 77.10% <ø> (ø)
datadog-trace-utils 89.92% <ø> (ø)
datadog-tracer-flare 56.08% <ø> (ø)
datadog-log 76.31% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Copy link

datadog-official bot commented Aug 26, 2025

✅ Tests

🎉 All green!

❄️ No new flaky tests detected
🧪 All tests passed

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: b1013b6 | Docs | Was this helpful? Give us feedback!

@gleocadie gleocadie force-pushed the gleocadie/check-crashing-thread-callstack branch 3 times, most recently from 3f7bf3a to a638e6c Compare August 26, 2025 20:25
@gleocadie gleocadie force-pushed the gleocadie/check-crashing-thread-callstack branch from a638e6c to 85bcfae Compare August 27, 2025 14:54
@gleocadie gleocadie changed the title Check callstack [crashtracker] Add test to check callstack Aug 27, 2025
@pr-commenter
Copy link

pr-commenter bot commented Aug 27, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-08-27 16:10:52

Comparing candidate commit b1013b6 in PR branch gleocadie/check-crashing-thread-callstack with baseline commit aa11985 in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

scenario:benching deserializing traces from msgpack to their internal representation

  • 🟥 execution_time [+8.459ms; +9.358ms] or [+13.532%; +14.970%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b1013b6 1756310282 gleocadie/check-crashing-thread-callstack
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 154.385µs 155.295µs ± 0.346µs 155.226µs ± 0.168µs 155.426µs 155.987µs 156.326µs 157.419µs 1.41% 1.969 7.842 0.22% 0.024µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [155.247µs; 155.343µs] or [-0.031%; +0.031%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b1013b6 1756310282 gleocadie/check-crashing-thread-callstack
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 70.816ms 71.420ms ± 2.512ms 71.110ms ± 0.081ms 71.192ms 71.342ms 90.181ms 93.645ms 31.69% 8.006 62.672 3.51% 0.178ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [71.072ms; 71.769ms] or [-0.487%; +0.487%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b1013b6 1756310282 gleocadie/check-crashing-thread-callstack
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 89.514µs 89.698µs ± 0.222µs 89.669µs ± 0.043µs 89.717µs 89.819µs 90.072µs 92.604µs 3.27% 11.344 145.036 0.25% 0.016µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [89.667µs; 89.729µs] or [-0.034%; +0.034%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b1013b6 1756310282 gleocadie/check-crashing-thread-callstack
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.896µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.920µs 3.923µs 3.925µs 0.25% -0.603 6.041 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 254788833.408op/s 255408941.137op/s ± 204480.301op/s 255430101.558op/s ± 116075.266op/s 255536100.863op/s 255652985.327op/s 255795440.668op/s 256652987.883op/s 0.48% 0.621 6.144 0.08% 14458.941op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 78.303µs 79.841µs ± 0.558µs 79.847µs ± 0.396µs 80.255µs 80.718µs 81.088µs 81.325µs 1.85% -0.027 -0.235 0.70% 0.039µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12296356.354op/s 12525501.761op/s ± 87499.629op/s 12523888.067op/s ± 62097.163op/s 12583977.602op/s 12665845.417op/s 12705574.171op/s 12770868.851op/s 1.97% 0.064 -0.227 0.70% 6187.158op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 71.412µs 71.834µs ± 0.272µs 71.778µs ± 0.210µs 72.011µs 72.333µs 72.558µs 72.721µs 1.31% 0.772 0.309 0.38% 0.019µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13751095.545op/s 13921271.254op/s ± 52643.764op/s 13931846.804op/s ± 40693.705op/s 13960125.848op/s 13990352.533op/s 13995026.589op/s 14003170.318op/s 0.51% -0.753 0.264 0.38% 3722.476op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.896µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.920µs 3.922µs 3.929µs 0.37% -0.470 8.394 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254488433.924op/s 255419651.870op/s ± 198760.338op/s 255422658.019op/s ± 120516.001op/s 255541321.034op/s 255692104.036op/s 255755953.401op/s 256661367.020op/s 0.48% 0.494 8.484 0.08% 14054.478op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 68.252µs 68.774µs ± 0.298µs 68.714µs ± 0.210µs 68.969µs 69.253µs 69.536µs 69.877µs 1.69% 0.608 0.293 0.43% 0.021µs 1 200
credit_card/is_card_number/378282246310005 throughput 14310866.123op/s 14540627.582op/s ± 62928.385op/s 14553135.277op/s ± 44507.041op/s 14584494.547op/s 14632416.949op/s 14646926.821op/s 14651570.598op/s 0.68% -0.583 0.234 0.43% 4449.709op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.360µs 45.734µs ± 0.149µs 45.752µs ± 0.116µs 45.867µs 45.921µs 45.955µs 46.001µs 0.54% -0.590 -0.468 0.33% 0.011µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21738657.855op/s 21865634.692op/s ± 71391.442op/s 21856925.465op/s ± 55204.499op/s 21913868.740op/s 21998219.120op/s 22040743.310op/s 22045722.224op/s 0.86% 0.601 -0.450 0.33% 5048.137op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.570µs 6.623µs ± 0.017µs 6.631µs ± 0.007µs 6.635µs 6.640µs 6.643µs 6.646µs 0.23% -1.177 0.507 0.25% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 150472154.934op/s 150979107.014op/s ± 384537.269op/s 150815351.107op/s ± 159719.134op/s 151160127.725op/s 151728951.633op/s 152075004.943op/s 152197511.475op/s 0.92% 1.186 0.534 0.25% 27190.891op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.901µs 3.915µs ± 0.003µs 3.914µs ± 0.002µs 3.916µs 3.918µs 3.921µs 3.921µs 0.17% -0.597 3.547 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255035018.616op/s 255453429.441op/s ± 165176.865op/s 255466410.837op/s ± 107423.750op/s 255550644.072op/s 255699266.735op/s 255756066.936op/s 256363575.566op/s 0.35% 0.607 3.598 0.06% 11679.768op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.111µs 65.735µs ± 0.065µs 65.734µs ± 0.031µs 65.771µs 65.815µs 65.854µs 65.885µs 0.23% -4.217 40.091 0.10% 0.005µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15178029.356op/s 15212596.292op/s ± 15177.032op/s 15212750.323op/s ± 7238.198op/s 15219784.885op/s 15228017.850op/s 15240960.773op/s 15358435.776op/s 0.96% 4.289 40.963 0.10% 1073.178op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.359µs 53.430µs ± 0.037µs 53.425µs ± 0.024µs 53.452µs 53.491µs 53.544µs 53.555µs 0.24% 0.709 0.814 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18672353.921op/s 18716134.639op/s ± 12947.739op/s 18717993.662op/s ± 8477.671op/s 18724966.252op/s 18735771.247op/s 18737840.532op/s 18741029.477op/s 0.12% -0.704 0.803 0.07% 915.543op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.899µs 3.914µs ± 0.002µs 3.914µs ± 0.001µs 3.915µs 3.918µs 3.919µs 3.919µs 0.14% -1.240 10.115 0.05% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255144150.453op/s 255492769.658op/s ± 139845.032op/s 255505582.797op/s ± 75120.267op/s 255571195.765op/s 255665794.162op/s 255737702.360op/s 256457612.726op/s 0.37% 1.257 10.244 0.05% 9888.537op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.149µs 50.214µs ± 0.033µs 50.213µs ± 0.022µs 50.233µs 50.267µs 50.305µs 50.325µs 0.22% 0.389 0.023 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19870910.616op/s 19914594.877op/s ± 12956.390op/s 19915248.668op/s ± 8678.953op/s 19924425.661op/s 19934378.419op/s 19938444.221op/s 19940608.890op/s 0.13% -0.385 0.017 0.06% 916.155op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.312µs 45.766µs ± 0.148µs 45.796µs ± 0.099µs 45.889µs 45.943µs 45.967µs 46.016µs 0.48% -0.804 0.013 0.32% 0.010µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21731625.538op/s 21850580.399op/s ± 70634.503op/s 21836110.817op/s ± 47201.571op/s 21887963.297op/s 21990079.835op/s 22038962.528op/s 22069160.112op/s 1.07% 0.817 0.043 0.32% 4994.614op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.576µs 6.625µs ± 0.015µs 6.630µs ± 0.010µs 6.637µs 6.642µs 6.644µs 6.651µs 0.31% -0.847 0.147 0.22% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 150361783.786op/s 150940323.750op/s ± 335296.075op/s 150823126.447op/s ± 221902.626op/s 151165277.058op/s 151557671.583op/s 151854594.688op/s 152075656.582op/s 0.83% 0.856 0.174 0.22% 23709.013op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.915µs; 3.916µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ throughput [255380602.134op/s; 255437280.140op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [79.764µs; 79.918µs] or [-0.097%; +0.097%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12513375.154op/s; 12537628.368op/s] or [-0.097%; +0.097%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.796µs; 71.871µs] or [-0.053%; +0.053%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13913975.335op/s; 13928567.174op/s] or [-0.052%; +0.052%] None None None
credit_card/is_card_number/37828224631 execution_time [3.915µs; 3.916µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255392105.599op/s; 255447198.142op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.733µs; 68.815µs] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/378282246310005 throughput [14531906.313op/s; 14549348.851op/s] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.714µs; 45.755µs] or [-0.045%; +0.045%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21855740.525op/s; 21875528.859op/s] or [-0.045%; +0.045%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.621µs; 6.626µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number/x371413321323331 throughput [150925813.847op/s; 151032400.182op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.914µs; 3.915µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [255430537.516op/s; 255476321.366op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.726µs; 65.744µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15210492.901op/s; 15214699.682op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.425µs; 53.435µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18714340.207op/s; 18717929.071op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.914µs; 3.914µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255473388.481op/s; 255512150.834op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.210µs; 50.219µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19912799.246op/s; 19916390.508op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.745µs; 45.786µs] or [-0.045%; +0.045%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21840791.136op/s; 21860369.662op/s] or [-0.045%; +0.045%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.623µs; 6.627µs] or [-0.031%; +0.031%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [150893854.938op/s; 150986792.561op/s] or [-0.031%; +0.031%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b1013b6 1756310282 gleocadie/check-crashing-thread-callstack
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.187µs 185.752µs ± 0.269µs 185.729µs ± 0.186µs 185.913µs 186.233µs 186.426µs 186.760µs 0.56% 0.756 0.651 0.14% 0.019µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5354461.324op/s 5383542.578op/s ± 7785.002op/s 5384184.443op/s ± 5401.430op/s 5389659.769op/s 5393605.764op/s 5396519.791op/s 5399947.081op/s 0.29% -0.747 0.629 0.14% 550.483op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.703µs 17.791µs ± 0.041µs 17.783µs ± 0.025µs 17.812µs 17.865µs 17.915µs 17.927µs 0.81% 0.989 1.044 0.23% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55781833.966op/s 56209288.515op/s ± 129760.095op/s 56232856.956op/s ± 78684.994op/s 56298194.982op/s 56375773.047op/s 56414715.926op/s 56486662.502op/s 0.45% -0.975 1.008 0.23% 9175.424op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.199µs 10.355µs ± 0.171µs 10.284µs ± 0.024µs 10.315µs 10.749µs 10.805µs 10.814µs 5.15% 1.711 1.168 1.64% 0.012µs 1 200
normalization/normalize_name/normalize_name/good throughput 92471748.830op/s 96597147.321op/s ± 1547292.118op/s 97235957.497op/s ± 224892.058op/s 97410432.218op/s 97684030.326op/s 97860204.479op/s 98053198.317op/s 0.84% -1.700 1.133 1.60% 109410.075op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [185.714µs; 185.789µs] or [-0.020%; +0.020%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5382463.652op/s; 5384621.504op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.785µs; 17.796µs] or [-0.032%; +0.032%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [56191305.014op/s; 56227272.016op/s] or [-0.032%; +0.032%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.331µs; 10.379µs] or [-0.228%; +0.228%] None None None
normalization/normalize_name/normalize_name/good throughput [96382707.515op/s; 96811587.127op/s] or [-0.222%; +0.222%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b1013b6 1756310282 gleocadie/check-crashing-thread-callstack
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 243.046ns 254.937ns ± 14.326ns 249.631ns ± 4.933ns 256.990ns 286.630ns 305.404ns 309.540ns 24.00% 1.748 2.480 5.61% 1.013ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.951ns; 256.922ns] or [-0.779%; +0.779%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b1013b6 1756310282 gleocadie/check-crashing-thread-callstack
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 13.963ms 14.017ms ± 0.034ms 14.013ms ± 0.015ms 14.028ms 14.082ms 14.142ms 14.233ms 1.57% 2.472 10.242 0.24% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.012ms; 14.022ms] or [-0.033%; +0.033%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b1013b6 1756310282 gleocadie/check-crashing-thread-callstack
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.998µs 5.109µs ± 0.060µs 5.088µs ± 0.044µs 5.154µs 5.199µs 5.204µs 5.206µs 2.33% 0.106 -1.112 1.18% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.100µs; 5.117µs] or [-0.164%; +0.164%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b1013b6 1756310282 gleocadie/check-crashing-thread-callstack
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.185ms 8.204ms ± 0.009ms 8.203ms ± 0.006ms 8.209ms 8.219ms 8.230ms 8.258ms 0.67% 1.550 5.844 0.11% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [8.203ms; 8.205ms] or [-0.016%; +0.016%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b1013b6 1756310282 gleocadie/check-crashing-thread-callstack
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.184µs 3.226µs ± 1.430µs 3.005µs ± 0.031µs 3.035µs 3.666µs 13.761µs 15.096µs 402.29% 7.308 54.899 44.22% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.027µs; 3.424µs] or [-6.144%; +6.144%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b1013b6 1756310282 gleocadie/check-crashing-thread-callstack
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 494.500µs 495.485µs ± 1.016µs 495.298µs ± 0.307µs 495.637µs 496.196µs 499.019µs 505.567µs 2.07% 6.114 50.982 0.20% 0.072µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1977976.332op/s 2018234.125op/s ± 4086.105op/s 2018985.417op/s ± 1253.243op/s 2020027.960op/s 2021322.255op/s 2021824.813op/s 2022242.647op/s 0.16% -6.020 49.603 0.20% 288.931op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 370.098µs 371.098µs ± 0.409µs 371.068µs ± 0.237µs 371.302µs 371.715µs 372.237µs 373.728µs 0.72% 1.580 7.928 0.11% 0.029µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2675739.673op/s 2694707.177op/s ± 2961.944op/s 2694922.894op/s ± 1720.298op/s 2696655.666op/s 2698777.646op/s 2700238.765op/s 2701986.406op/s 0.26% -1.556 7.756 0.11% 209.441op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 167.093µs 167.624µs ± 0.179µs 167.614µs ± 0.085µs 167.698µs 167.835µs 167.991µs 168.915µs 0.78% 2.583 17.524 0.11% 0.013µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5920120.231op/s 5965754.191op/s ± 6338.155op/s 5966104.893op/s ± 3028.053op/s 5969089.694op/s 5973661.588op/s 5978643.197op/s 5984690.327op/s 0.31% -2.543 17.216 0.11% 448.175op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.394µs 36.636µs ± 0.091µs 36.635µs ± 0.064µs 36.699µs 36.774µs 36.855µs 36.882µs 0.67% 0.040 -0.114 0.25% 0.006µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 27113467.353op/s 27295451.228op/s ± 67449.106op/s 27296185.073op/s ± 47552.718op/s 27345112.073op/s 27404909.538op/s 27443150.058op/s 27476873.367op/s 0.66% -0.026 -0.117 0.25% 4769.372op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.442µs 45.612µs ± 0.118µs 45.604µs ± 0.046µs 45.655µs 45.695µs 45.762µs 46.769µs 2.55% 6.392 56.046 0.26% 0.008µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21381857.162op/s 21924420.270op/s ± 55780.033op/s 21927989.214op/s ± 22342.559op/s 21949766.010op/s 21980009.573op/s 21993493.315op/s 22006073.676op/s 0.36% -6.260 54.409 0.25% 3944.244op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [495.344µs; 495.625µs] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2017667.830op/s; 2018800.420op/s] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [371.042µs; 371.155µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2694296.680op/s; 2695117.674op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [167.599µs; 167.648µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5964875.783op/s; 5966632.598op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.624µs; 36.649µs] or [-0.034%; +0.034%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27286103.431op/s; 27304799.026op/s] or [-0.034%; +0.034%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.595µs; 45.628µs] or [-0.036%; +0.036%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21916689.694op/s; 21932150.846op/s] or [-0.035%; +0.035%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b1013b6 1756310282 gleocadie/check-crashing-thread-callstack
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.482µs 34.108µs ± 1.105µs 33.599µs ± 0.043µs 33.669µs 36.486µs 36.556µs 37.160µs 10.60% 1.701 0.942 3.23% 0.078µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.955µs; 34.262µs] or [-0.449%; +0.449%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b1013b6 1756310282 gleocadie/check-crashing-thread-callstack
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.083µs 26.257µs ± 9.486µs 18.675µs ± 0.283µs 34.773µs 43.999µs 44.702µs 54.019µs 189.26% 0.719 -0.826 36.04% 0.671µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.942µs; 27.571µs] or [-5.007%; +5.007%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz b1013b6 1756310282 gleocadie/check-crashing-thread-callstack
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.323µs 2.388µs ± 0.016µs 2.389µs ± 0.005µs 2.396µs 2.403µs 2.414µs 2.420µs 1.27% -2.234 5.833 0.68% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.385µs; 2.390µs] or [-0.095%; +0.095%] None None None

Baseline

Omitted due to size.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants