Skip to content

Conversation

@mhlidd
Copy link
Contributor

@mhlidd mhlidd commented Oct 8, 2025

What Does This Do

dd-trace-java has 31 configurations that are shared with other tracers, but have different aliases, and thus need to be mapped to a new "version". This PR updates the mapping of these configurations to be consistent with the Feature Parity Dashboard.

This PR also adds 1 config that was missing previously in the file.

Motivation

This needs to be done in order to consider Config Inversion implementation in Java as complete.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@mhlidd mhlidd requested a review from a team as a code owner October 8, 2025 18:43
@mhlidd mhlidd requested review from AlexeyKuznetsov-DD and removed request for a team October 8, 2025 18:43
@github-actions
Copy link
Contributor

github-actions bot commented Oct 8, 2025

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@mhlidd mhlidd added type: documentation tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Oct 8, 2025
Copy link
Contributor

@sarahchen6 sarahchen6 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just to confirm -- the "B" label means that the configuration is shared with other tracers so has different aliases?

are the labels possibly documented somewhere? if not maybe a comment could be helpful

@mhlidd
Copy link
Contributor Author

mhlidd commented Oct 8, 2025

just to confirm -- the "B" label means that the configuration is shared with other tracers so has different aliases?

are the labels possibly documented somewhere? if not maybe a comment could be helpful

No, labels are typically auto-generated when a new configuration is added to the FPD. (Essentially just in alphabetical order). So if I add a config that doesn't exist, it would be given a version of A and if it already exists, a value of B, C, and so on.

Note: This isn't something that devs will typically need to worry about, but rather needed to make the initial state valid. JSON also doesn't support comments 😞 but I'll think of where this makes sense to document!

@sarahchen6
Copy link
Contributor

Ohh interesting okay thanks for the clarification!

@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Oct 8, 2025

🎯 Code Coverage
Patch Coverage: 100.00%
Total Coverage: 59.66% (-0.03%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 38ceec6 | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Oct 8, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/update_supported_configurations
git_commit_date 1760040282 1760041586
git_commit_sha 295f7bf 38ceec6
release_version 1.55.0-SNAPSHOT~295f7bf5b4 1.55.0-SNAPSHOT~38ceec6d21
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1760043399 1760043399
ci_job_id 1172872528 1172872528
ci_pipeline_id 78905436 78905436
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-kg8nqzbv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-kg8nqzbv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 5 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~38ceec6d21, baseline=1.55.0-SNAPSHOT~295f7bf5b4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.017 s) : 0, 1017285
Total [baseline] (10.642 s) : 0, 10642130
Agent [candidate] (1.017 s) : 0, 1017197
Total [candidate] (10.868 s) : 0, 10868172
section appsec
Agent [baseline] (1.193 s) : 0, 1193408
Total [baseline] (11.12 s) : 0, 11119980
Agent [candidate] (1.195 s) : 0, 1194949
Total [candidate] (11.066 s) : 0, 11066354
section iast
Agent [baseline] (1.15 s) : 0, 1150238
Total [baseline] (10.989 s) : 0, 10989456
Agent [candidate] (1.148 s) : 0, 1148331
Total [candidate] (11.035 s) : 0, 11034556
section profiling
Agent [baseline] (1.165 s) : 0, 1164509
Total [baseline] (11.123 s) : 0, 11122784
Agent [candidate] (1.16 s) : 0, 1159927
Total [candidate] (11.069 s) : 0, 11068761
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.017 s -
Agent appsec 1.193 s 176.122 ms (17.3%)
Agent iast 1.15 s 132.953 ms (13.1%)
Agent profiling 1.165 s 147.224 ms (14.5%)
Total tracing 10.642 s -
Total appsec 11.12 s 477.849 ms (4.5%)
Total iast 10.989 s 347.325 ms (3.3%)
Total profiling 11.123 s 480.653 ms (4.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.017 s -
Agent appsec 1.195 s 177.753 ms (17.5%)
Agent iast 1.148 s 131.135 ms (12.9%)
Agent profiling 1.16 s 142.731 ms (14.0%)
Total tracing 10.868 s -
Total appsec 11.066 s 198.181 ms (1.8%)
Total iast 11.035 s 166.384 ms (1.5%)
Total profiling 11.069 s 200.589 ms (1.8%)
gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~38ceec6d21, baseline=1.55.0-SNAPSHOT~295f7bf5b4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.477 ms) : 0, 1477
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (693.832 ms) : 0, 693832
BytebuddyAgent [candidate] (693.863 ms) : 0, 693863
GlobalTracer [baseline] (241.755 ms) : 0, 241755
GlobalTracer [candidate] (241.965 ms) : 0, 241965
AppSec [baseline] (32.252 ms) : 0, 32252
AppSec [candidate] (32.144 ms) : 0, 32144
Debugger [baseline] (6.409 ms) : 0, 6409
Debugger [candidate] (6.4 ms) : 0, 6400
Remote Config [baseline] (701.195 µs) : 0, 701
Remote Config [candidate] (707.41 µs) : 0, 707
Telemetry [baseline] (9.343 ms) : 0, 9343
Telemetry [candidate] (9.337 ms) : 0, 9337
Flare Poller [baseline] (10.313 ms) : 0, 10313
Flare Poller [candidate] (10.135 ms) : 0, 10135
section appsec
crashtracking [baseline] (1.474 ms) : 0, 1474
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (717.093 ms) : 0, 717093
BytebuddyAgent [candidate] (718.455 ms) : 0, 718455
GlobalTracer [baseline] (234.087 ms) : 0, 234087
GlobalTracer [candidate] (234.496 ms) : 0, 234496
AppSec [baseline] (175.704 ms) : 0, 175704
AppSec [candidate] (175.384 ms) : 0, 175384
Debugger [baseline] (6.091 ms) : 0, 6091
Debugger [candidate] (6.149 ms) : 0, 6149
Remote Config [baseline] (638.249 µs) : 0, 638
Remote Config [candidate] (630.892 µs) : 0, 631
Telemetry [baseline] (8.403 ms) : 0, 8403
Telemetry [candidate] (8.492 ms) : 0, 8492
Flare Poller [baseline] (3.926 ms) : 0, 3926
Flare Poller [candidate] (3.938 ms) : 0, 3938
IAST [baseline] (24.921 ms) : 0, 24921
IAST [candidate] (24.793 ms) : 0, 24793
section iast
crashtracking [baseline] (1.472 ms) : 0, 1472
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (814.27 ms) : 0, 814270
BytebuddyAgent [candidate] (813.105 ms) : 0, 813105
GlobalTracer [baseline] (231.82 ms) : 0, 231820
GlobalTracer [candidate] (231.25 ms) : 0, 231250
AppSec [baseline] (35.141 ms) : 0, 35141
AppSec [candidate] (35.296 ms) : 0, 35296
Debugger [baseline] (6.203 ms) : 0, 6203
Debugger [candidate] (6.089 ms) : 0, 6089
Remote Config [baseline] (611.605 µs) : 0, 612
Remote Config [candidate] (605.229 µs) : 0, 605
Telemetry [baseline] (8.624 ms) : 0, 8624
Telemetry [candidate] (8.612 ms) : 0, 8612
Flare Poller [baseline] (4.219 ms) : 0, 4219
Flare Poller [candidate] (4.15 ms) : 0, 4150
IAST [baseline] (26.5 ms) : 0, 26500
IAST [candidate] (26.413 ms) : 0, 26413
section profiling
ProfilingAgent [baseline] (107.776 ms) : 0, 107776
ProfilingAgent [candidate] (107.5 ms) : 0, 107500
crashtracking [baseline] (1.439 ms) : 0, 1439
crashtracking [candidate] (1.436 ms) : 0, 1436
BytebuddyAgent [baseline] (722.571 ms) : 0, 722571
BytebuddyAgent [candidate] (720.075 ms) : 0, 720075
GlobalTracer [baseline] (218.973 ms) : 0, 218973
GlobalTracer [candidate] (217.365 ms) : 0, 217365
AppSec [baseline] (32.717 ms) : 0, 32717
AppSec [candidate] (32.648 ms) : 0, 32648
Debugger [baseline] (6.443 ms) : 0, 6443
Debugger [candidate] (7.196 ms) : 0, 7196
Remote Config [baseline] (702.74 µs) : 0, 703
Remote Config [candidate] (704.449 µs) : 0, 704
Telemetry [baseline] (15.093 ms) : 0, 15093
Telemetry [candidate] (15.85 ms) : 0, 15850
Flare Poller [baseline] (5.751 ms) : 0, 5751
Flare Poller [candidate] (4.135 ms) : 0, 4135
Profiling [baseline] (108.757 ms) : 0, 108757
Profiling [candidate] (108.629 ms) : 0, 108629
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~38ceec6d21, baseline=1.55.0-SNAPSHOT~295f7bf5b4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.023 s) : 0, 1023072
Total [baseline] (8.689 s) : 0, 8689288
Agent [candidate] (1.017 s) : 0, 1017074
Total [candidate] (8.672 s) : 0, 8671521
section iast
Agent [baseline] (1.149 s) : 0, 1149152
Total [baseline] (9.324 s) : 0, 9324097
Agent [candidate] (1.15 s) : 0, 1149996
Total [candidate] (9.29 s) : 0, 9289988
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent iast 1.149 s 126.079 ms (12.3%)
Total tracing 8.689 s -
Total iast 9.324 s 634.809 ms (7.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.017 s -
Agent iast 1.15 s 132.922 ms (13.1%)
Total tracing 8.672 s -
Total iast 9.29 s 618.468 ms (7.1%)
gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~38ceec6d21, baseline=1.55.0-SNAPSHOT~295f7bf5b4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.474 ms) : 0, 1474
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (696.871 ms) : 0, 696871
BytebuddyAgent [candidate] (693.166 ms) : 0, 693166
GlobalTracer [baseline] (243.11 ms) : 0, 243110
GlobalTracer [candidate] (241.704 ms) : 0, 241704
AppSec [baseline] (32.513 ms) : 0, 32513
AppSec [candidate] (32.208 ms) : 0, 32208
Debugger [baseline] (6.462 ms) : 0, 6462
Debugger [candidate] (6.376 ms) : 0, 6376
Remote Config [baseline] (701.141 µs) : 0, 701
Remote Config [candidate] (711.975 µs) : 0, 712
Telemetry [baseline] (9.345 ms) : 0, 9345
Telemetry [candidate] (9.325 ms) : 0, 9325
Flare Poller [baseline] (11.349 ms) : 0, 11349
Flare Poller [candidate] (11.022 ms) : 0, 11022
section iast
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.479 ms) : 0, 1479
BytebuddyAgent [baseline] (814.091 ms) : 0, 814091
BytebuddyAgent [candidate] (814.159 ms) : 0, 814159
GlobalTracer [baseline] (231.288 ms) : 0, 231288
GlobalTracer [candidate] (231.781 ms) : 0, 231781
AppSec [baseline] (34.985 ms) : 0, 34985
AppSec [candidate] (35.3 ms) : 0, 35300
Debugger [baseline] (6.124 ms) : 0, 6124
Debugger [candidate] (6.107 ms) : 0, 6107
Remote Config [baseline] (613.287 µs) : 0, 613
Remote Config [candidate] (602.831 µs) : 0, 603
Telemetry [baseline] (8.612 ms) : 0, 8612
Telemetry [candidate] (8.508 ms) : 0, 8508
Flare Poller [baseline] (4.27 ms) : 0, 4270
Flare Poller [candidate] (4.22 ms) : 0, 4220
IAST [baseline] (26.414 ms) : 0, 26414
IAST [candidate] (26.611 ms) : 0, 26611
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/update_supported_configurations
git_commit_date 1760040282 1760041586
git_commit_sha 295f7bf 38ceec6
release_version 1.55.0-SNAPSHOT~295f7bf5b4 1.55.0-SNAPSHOT~38ceec6d21
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1760043143 1760043143
ci_job_id 1172872529 1172872529
ci_pipeline_id 78905436 78905436
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-bid7nt62 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-bid7nt62 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 3 performance regressions! Performance is the same for 5 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-748.864µs; -405.307µs] or [-7.523%; -4.072%]
unstable
[-34.450op/s; +91.263op/s] or [-7.382%; +19.555%]
9.377ms 495.094op/s 9.954ms 466.688op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+408.645µs; +1030.493µs] or [+2.904%; +7.324%]
unstable
[-55.385op/s; +23.135op/s] or [-16.717%; +6.983%]
14.790ms 315.188op/s 14.070ms 331.312op/s
scenario:load:petclinic:profiling:high_load worse
[+1.898ms; +2.830ms] or [+4.097%; +6.109%]
unstable
[-12.162op/s; +2.312op/s] or [-12.031%; +2.287%]
48.687ms 96.162op/s 46.323ms 101.088op/s
scenario:load:petclinic:no_agent:high_load better
[-1.527ms; -0.879ms] or [-4.051%; -2.330%]
unstable
[-4.735op/s; +12.985op/s] or [-3.819%; +10.473%]
36.505ms 128.113op/s 37.708ms 123.987op/s
scenario:load:petclinic:code_origins:high_load better
[-3.126ms; -2.302ms] or [-6.856%; -5.050%]
unstable
[-1.063op/s; +14.063op/s] or [-1.036%; +13.700%]
42.880ms 109.150op/s 45.594ms 102.650op/s
scenario:load:petclinic:iast:high_load better
[-2.285ms; -1.412ms] or [-4.879%; -3.016%]
unstable
[-3.240op/s; +11.540op/s] or [-3.242%; +11.550%]
44.978ms 104.062op/s 46.827ms 99.912op/s
scenario:load:petclinic:tracing:high_load worse
[+0.956ms; +1.818ms] or [+2.155%; +4.098%]
unstable
[-10.727op/s; +4.427op/s] or [-10.173%; +4.199%]
45.757ms 102.300op/s 44.370ms 105.450op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~38ceec6d21, baseline=1.55.0-SNAPSHOT~295f7bf5b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.708 ms) : 37403, 38014
.   : milestone, 37708,
appsec (48.77 ms) : 48342, 49198
.   : milestone, 48770,
code_origins (45.594 ms) : 45197, 45992
.   : milestone, 45594,
iast (46.827 ms) : 46407, 47247
.   : milestone, 46827,
profiling (46.323 ms) : 45928, 46717
.   : milestone, 46323,
tracing (44.37 ms) : 43987, 44754
.   : milestone, 44370,
section candidate
no_agent (36.505 ms) : 36208, 36803
.   : milestone, 36505,
appsec (48.882 ms) : 48456, 49308
.   : milestone, 48882,
code_origins (42.88 ms) : 42512, 43247
.   : milestone, 42880,
iast (44.978 ms) : 44588, 45369
.   : milestone, 44978,
profiling (48.687 ms) : 48218, 49155
.   : milestone, 48687,
tracing (45.757 ms) : 45341, 46174
.   : milestone, 45757,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.708 ms [37.403 ms, 38.014 ms] -
appsec 48.77 ms [48.342 ms, 49.198 ms] 11.062 ms (29.3%)
code_origins 45.594 ms [45.197 ms, 45.992 ms] 7.886 ms (20.9%)
iast 46.827 ms [46.407 ms, 47.247 ms] 9.118 ms (24.2%)
profiling 46.323 ms [45.928 ms, 46.717 ms] 8.614 ms (22.8%)
tracing 44.37 ms [43.987 ms, 44.754 ms] 6.662 ms (17.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.505 ms [36.208 ms, 36.803 ms] -
appsec 48.882 ms [48.456 ms, 49.308 ms] 12.377 ms (33.9%)
code_origins 42.88 ms [42.512 ms, 43.247 ms] 6.374 ms (17.5%)
iast 44.978 ms [44.588 ms, 45.369 ms] 8.473 ms (23.2%)
profiling 48.687 ms [48.218 ms, 49.155 ms] 12.181 ms (33.4%)
tracing 45.757 ms [45.341 ms, 46.174 ms] 9.252 ms (25.3%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~38ceec6d21, baseline=1.55.0-SNAPSHOT~295f7bf5b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.321 ms) : 4269, 4372
.   : milestone, 4321,
iast (9.954 ms) : 9788, 10120
.   : milestone, 9954,
iast_FULL (14.07 ms) : 13788, 14353
.   : milestone, 14070,
iast_GLOBAL (11.163 ms) : 10963, 11363
.   : milestone, 11163,
profiling (8.662 ms) : 8526, 8798
.   : milestone, 8662,
tracing (8.144 ms) : 8021, 8266
.   : milestone, 8144,
section candidate
no_agent (4.239 ms) : 4188, 4289
.   : milestone, 4239,
iast (9.377 ms) : 9224, 9530
.   : milestone, 9377,
iast_FULL (14.79 ms) : 14494, 15085
.   : milestone, 14790,
iast_GLOBAL (10.77 ms) : 10578, 10963
.   : milestone, 10770,
profiling (8.876 ms) : 8739, 9013
.   : milestone, 8876,
tracing (7.966 ms) : 7846, 8086
.   : milestone, 7966,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.321 ms [4.269 ms, 4.372 ms] -
iast 9.954 ms [9.788 ms, 10.12 ms] 5.634 ms (130.4%)
iast_FULL 14.07 ms [13.788 ms, 14.353 ms] 9.75 ms (225.7%)
iast_GLOBAL 11.163 ms [10.963 ms, 11.363 ms] 6.842 ms (158.4%)
profiling 8.662 ms [8.526 ms, 8.798 ms] 4.341 ms (100.5%)
tracing 8.144 ms [8.021 ms, 8.266 ms] 3.823 ms (88.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.239 ms [4.188 ms, 4.289 ms] -
iast 9.377 ms [9.224 ms, 9.53 ms] 5.139 ms (121.2%)
iast_FULL 14.79 ms [14.494 ms, 15.085 ms] 10.551 ms (248.9%)
iast_GLOBAL 10.77 ms [10.578 ms, 10.963 ms] 6.531 ms (154.1%)
profiling 8.876 ms [8.739 ms, 9.013 ms] 4.637 ms (109.4%)
tracing 7.966 ms [7.846 ms, 8.086 ms] 3.727 ms (87.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/update_supported_configurations
git_commit_date 1760040282 1760041586
git_commit_sha 295f7bf 38ceec6
release_version 1.55.0-SNAPSHOT~295f7bf5b4 1.55.0-SNAPSHOT~38ceec6d21
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1760043626 1760043626
ci_job_id 1172872530 1172872530
ci_pipeline_id 78905436 78905436
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-a40a3zdy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-a40a3zdy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.338ms; -1.001ms] or [-36.436%; -27.266%]
2.502ms 3.672ms
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~38ceec6d21, baseline=1.55.0-SNAPSHOT~295f7bf5b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.618 s) : 15618000, 15618000
.   : milestone, 15618000,
appsec (15.11 s) : 15110000, 15110000
.   : milestone, 15110000,
iast (18.568 s) : 18568000, 18568000
.   : milestone, 18568000,
iast_GLOBAL (18.355 s) : 18355000, 18355000
.   : milestone, 18355000,
profiling (14.956 s) : 14956000, 14956000
.   : milestone, 14956000,
tracing (15.205 s) : 15205000, 15205000
.   : milestone, 15205000,
section candidate
no_agent (14.94 s) : 14940000, 14940000
.   : milestone, 14940000,
appsec (15.087 s) : 15087000, 15087000
.   : milestone, 15087000,
iast (18.746 s) : 18746000, 18746000
.   : milestone, 18746000,
iast_GLOBAL (17.905 s) : 17905000, 17905000
.   : milestone, 17905000,
profiling (15.474 s) : 15474000, 15474000
.   : milestone, 15474000,
tracing (15.124 s) : 15124000, 15124000
.   : milestone, 15124000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.618 s [15.618 s, 15.618 s] -
appsec 15.11 s [15.11 s, 15.11 s] -508.0 ms (-3.3%)
iast 18.568 s [18.568 s, 18.568 s] 2.95 s (18.9%)
iast_GLOBAL 18.355 s [18.355 s, 18.355 s] 2.737 s (17.5%)
profiling 14.956 s [14.956 s, 14.956 s] -662.0 ms (-4.2%)
tracing 15.205 s [15.205 s, 15.205 s] -413.0 ms (-2.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.94 s [14.94 s, 14.94 s] -
appsec 15.087 s [15.087 s, 15.087 s] 147.0 ms (1.0%)
iast 18.746 s [18.746 s, 18.746 s] 3.806 s (25.5%)
iast_GLOBAL 17.905 s [17.905 s, 17.905 s] 2.965 s (19.8%)
profiling 15.474 s [15.474 s, 15.474 s] 534.0 ms (3.6%)
tracing 15.124 s [15.124 s, 15.124 s] 184.0 ms (1.2%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~38ceec6d21, baseline=1.55.0-SNAPSHOT~295f7bf5b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (3.672 ms) : 3457, 3886
.   : milestone, 3672,
iast (2.214 ms) : 2150, 2277
.   : milestone, 2214,
iast_GLOBAL (2.259 ms) : 2195, 2323
.   : milestone, 2259,
profiling (2.051 ms) : 2000, 2102
.   : milestone, 2051,
tracing (2.019 ms) : 1970, 2069
.   : milestone, 2019,
section candidate
no_agent (1.478 ms) : 1467, 1490
.   : milestone, 1478,
appsec (2.502 ms) : 2449, 2556
.   : milestone, 2502,
iast (2.21 ms) : 2146, 2273
.   : milestone, 2210,
iast_GLOBAL (2.252 ms) : 2188, 2316
.   : milestone, 2252,
profiling (2.048 ms) : 1997, 2099
.   : milestone, 2048,
tracing (2.034 ms) : 1984, 2084
.   : milestone, 2034,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 3.672 ms [3.457 ms, 3.886 ms] 2.197 ms (149.0%)
iast 2.214 ms [2.15 ms, 2.277 ms] 739.346 µs (50.1%)
iast_GLOBAL 2.259 ms [2.195 ms, 2.323 ms] 784.737 µs (53.2%)
profiling 2.051 ms [2.0 ms, 2.102 ms] 576.554 µs (39.1%)
tracing 2.019 ms [1.97 ms, 2.069 ms] 545.06 µs (37.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.467 ms, 1.49 ms] -
appsec 2.502 ms [2.449 ms, 2.556 ms] 1.024 ms (69.3%)
iast 2.21 ms [2.146 ms, 2.273 ms] 731.484 µs (49.5%)
iast_GLOBAL 2.252 ms [2.188 ms, 2.316 ms] 773.675 µs (52.3%)
profiling 2.048 ms [1.997 ms, 2.099 ms] 569.881 µs (38.6%)
tracing 2.034 ms [1.984 ms, 2.084 ms] 555.983 µs (37.6%)

Copy link
Contributor

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  1. Probably make sense to add some docs into README.md that we have in \metadata folder?
  2. Is it possible to cover with some tests? Like query by http some dasboard and compare JSONs? (Just generating ideas).

@mhlidd
Copy link
Contributor Author

mhlidd commented Oct 8, 2025

Is it possible to cover with some tests? Like query by http some dasboard and compare JSONs? (Just generating ideas).

What tests are you imagining? We have a CI check in libdatadog-build that compares the data between this file and the data from the Feature Parity Dashboard. That is next on my list to incorporate into dd-trace-java.

@AlexeyKuznetsov-DD
Copy link
Contributor

Is it possible to cover with some tests? Like query by http some dasboard and compare JSONs? (Just generating ideas).

What tests are you imagining? We have a CI check in libdatadog-build that compares the data between this file and the data from the Feature Parity Dashboard. That is next on my list to incorporate into dd-trace-java.

OK.

@mhlidd mhlidd merged commit ef27983 into master Oct 10, 2025
532 checks passed
@mhlidd mhlidd deleted the mhlidd/update_supported_configurations branch October 10, 2025 17:42
@github-actions github-actions bot added this to the 1.55.0 milestone Oct 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants