Skip to content

Nikita tkachenko/junit6 integration #9509

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 4 commits into from
Sep 11, 2025
Merged

Nikita tkachenko/junit6 integration #9509

merged 4 commits into from
Sep 11, 2025

Conversation

@nikita-tkachenko-datadog
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog commented Sep 10, 2025 •
edited
Loading

What Does This Do

Updates JUnit instrumentation to support JUnit 6.

Additional Notes

Parameters reporting format changed in JUnit 6, so a separate set of test fixtures had to be added for JUnit 6 parameterized tests

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@nikita-tkachenko-datadog nikita-tkachenko-datadog added type: enhancement Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Sep 10, 2025
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Sep 10, 2025 •
edited by datadog-official bot
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 60.12% (-0.01%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 9cc5ae3 | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Sep 10, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/junit6-integration
git_commit_date 1757602568 1757613026
git_commit_sha fa49f3f 9cc5ae3
release_version 1.54.0-SNAPSHOT~fa49f3fb37 1.54.0-SNAPSHOT~9cc5ae37a5
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1757614920 1757614920
ci_job_id 1125288930 1125288930
ci_pipeline_id 76229086 76229086
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-xut35sfp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-xut35sfp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 6 performance improvements and 0 performance regressions! Performance is the same for 40 metrics, 13 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:GlobalTracer better
[-16.683ms; -8.235ms] or [-6.718%; -3.316%]		 235.890ms 248.349ms
scenario:startup:insecure-bank:tracing:GlobalTracer better
[-12.949ms; -6.756ms] or [-5.100%; -2.661%]		 244.064ms 253.917ms
scenario:startup:petclinic:appsec:GlobalTracer better
[-11.462ms; -8.413ms] or [-4.659%; -3.419%]		 236.112ms 246.050ms
scenario:startup:petclinic:iast:GlobalTracer better
[-15.622ms; -9.284ms] or [-6.336%; -3.765%]		 234.121ms 246.574ms
scenario:startup:petclinic:profiling:GlobalTracer better
[-11.915ms; -6.133ms] or [-5.113%; -2.632%]		 223.996ms 233.020ms
scenario:startup:petclinic:tracing:GlobalTracer better
[-14.590ms; -8.456ms] or [-5.725%; -3.318%]		 243.328ms 254.851ms
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~9cc5ae37a5, baseline=1.54.0-SNAPSHOT~fa49f3fb37

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.072 s) : 0, 1071793
Total [baseline] (10.844 s) : 0, 10844092
Agent [candidate] (1.05 s) : 0, 1049955
Total [candidate] (10.847 s) : 0, 10846585
section appsec
Agent [baseline] (1.236 s) : 0, 1236011
Total [baseline] (10.995 s) : 0, 10994929
Agent [candidate] (1.228 s) : 0, 1227982
Total [candidate] (10.862 s) : 0, 10862416
section iast
Agent [baseline] (1.2 s) : 0, 1200450
Total [baseline] (11.045 s) : 0, 11045030
Agent [candidate] (1.181 s) : 0, 1181088
Total [candidate] (10.943 s) : 0, 10942783
section profiling
Agent [baseline] (1.21 s) : 0, 1210177
Total [baseline] (11.004 s) : 0, 11003555
Agent [candidate] (1.208 s) : 0, 1207800
Total [candidate] (10.998 s) : 0, 10998140
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.072 s -
Agent appsec 1.236 s 164.218 ms (15.3%)
Agent iast 1.2 s 128.657 ms (12.0%)
Agent profiling 1.21 s 138.384 ms (12.9%)
Total tracing 10.844 s -
Total appsec 10.995 s 150.837 ms (1.4%)
Total iast 11.045 s 200.938 ms (1.9%)
Total profiling 11.004 s 159.463 ms (1.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.05 s -
Agent appsec 1.228 s 178.028 ms (17.0%)
Agent iast 1.181 s 131.133 ms (12.5%)
Agent profiling 1.208 s 157.846 ms (15.0%)
Total tracing 10.847 s -
Total appsec 10.862 s 15.831 ms (0.1%)
Total iast 10.943 s 96.198 ms (0.9%)
Total profiling 10.998 s 151.555 ms (1.4%) 
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~9cc5ae37a5, baseline=1.54.0-SNAPSHOT~fa49f3fb37

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.462 ms) : 0, 1462
BytebuddyAgent [baseline] (740.326 ms) : 0, 740326
BytebuddyAgent [candidate] (734.389 ms) : 0, 734389
GlobalTracer [baseline] (254.851 ms) : 0, 254851
GlobalTracer [candidate] (243.328 ms) : 0, 243328
AppSec [baseline] (30.954 ms) : 0, 30954
AppSec [candidate] (30.604 ms) : 0, 30604
Debugger [baseline] (6.459 ms) : 0, 6459
Debugger [candidate] (6.462 ms) : 0, 6462
Remote Config [baseline] (700.108 µs) : 0, 700
Remote Config [candidate] (676.247 µs) : 0, 676
Telemetry [baseline] (15.737 ms) : 0, 15737
Telemetry [candidate] (11.791 ms) : 0, 11791
section appsec
crashtracking [baseline] (1.475 ms) : 0, 1475
crashtracking [candidate] (1.455 ms) : 0, 1455
BytebuddyAgent [baseline] (756.359 ms) : 0, 756359
BytebuddyAgent [candidate] (756.943 ms) : 0, 756943
GlobalTracer [baseline] (246.05 ms) : 0, 246050
GlobalTracer [candidate] (236.112 ms) : 0, 236112
AppSec [baseline] (171.977 ms) : 0, 171977
AppSec [candidate] (171.104 ms) : 0, 171104
Debugger [baseline] (5.985 ms) : 0, 5985
Debugger [candidate] (7.605 ms) : 0, 7605
Remote Config [baseline] (643.567 µs) : 0, 644
Remote Config [candidate] (657.201 µs) : 0, 657
Telemetry [baseline] (8.445 ms) : 0, 8445
Telemetry [candidate] (9.319 ms) : 0, 9319
IAST [baseline] (23.789 ms) : 0, 23789
IAST [candidate] (23.602 ms) : 0, 23602
section iast
crashtracking [baseline] (1.455 ms) : 0, 1455
crashtracking [candidate] (1.479 ms) : 0, 1479
BytebuddyAgent [baseline] (860.442 ms) : 0, 860442
BytebuddyAgent [candidate] (851.964 ms) : 0, 851964
GlobalTracer [baseline] (246.574 ms) : 0, 246574
GlobalTracer [candidate] (234.121 ms) : 0, 234121
AppSec [baseline] (24.599 ms) : 0, 24599
AppSec [candidate] (27.104 ms) : 0, 27104
Debugger [baseline] (6.109 ms) : 0, 6109
Debugger [candidate] (6.116 ms) : 0, 6116
Remote Config [baseline] (603.255 µs) : 0, 603
Remote Config [candidate] (603.903 µs) : 0, 604
Telemetry [baseline] (8.164 ms) : 0, 8164
Telemetry [candidate] (8.25 ms) : 0, 8250
IAST [baseline] (31.376 ms) : 0, 31376
IAST [candidate] (30.297 ms) : 0, 30297
section profiling
crashtracking [baseline] (1.443 ms) : 0, 1443
crashtracking [candidate] (1.436 ms) : 0, 1436
BytebuddyAgent [baseline] (762.031 ms) : 0, 762031
BytebuddyAgent [candidate] (767.499 ms) : 0, 767499
GlobalTracer [baseline] (233.02 ms) : 0, 233020
GlobalTracer [candidate] (223.996 ms) : 0, 223996
AppSec [baseline] (30.322 ms) : 0, 30322
AppSec [candidate] (31.189 ms) : 0, 31189
Debugger [baseline] (8.273 ms) : 0, 8273
Debugger [candidate] (6.823 ms) : 0, 6823
Remote Config [baseline] (713.153 µs) : 0, 713
Remote Config [candidate] (691.088 µs) : 0, 691
Telemetry [baseline] (14.959 ms) : 0, 14959
Telemetry [candidate] (16.438 ms) : 0, 16438
ProfilingAgent [baseline] (108.079 ms) : 0, 108079
ProfilingAgent [candidate] (108.893 ms) : 0, 108893
Profiling [baseline] (108.746 ms) : 0, 108746
Profiling [candidate] (109.608 ms) : 0, 109608
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~9cc5ae37a5, baseline=1.54.0-SNAPSHOT~fa49f3fb37

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1071071
Total [baseline] (8.683 s) : 0, 8683238
Agent [candidate] (1.055 s) : 0, 1055374
Total [candidate] (8.684 s) : 0, 8684397
section iast
Agent [baseline] (1.202 s) : 0, 1201719
Total [baseline] (9.343 s) : 0, 9343447
Agent [candidate] (1.199 s) : 0, 1198618
Total [candidate] (9.368 s) : 0, 9368431
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.071 s -
Agent iast 1.202 s 130.649 ms (12.2%)
Total tracing 8.683 s -
Total iast 9.343 s 660.209 ms (7.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.199 s 143.245 ms (13.6%)
Total tracing 8.684 s -
Total iast 9.368 s 684.033 ms (7.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~9cc5ae37a5, baseline=1.54.0-SNAPSHOT~fa49f3fb37

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.487 ms) : 0, 1487
crashtracking [candidate] (1.468 ms) : 0, 1468
BytebuddyAgent [baseline] (739.945 ms) : 0, 739945
BytebuddyAgent [candidate] (737.761 ms) : 0, 737761
GlobalTracer [baseline] (253.917 ms) : 0, 253917
GlobalTracer [candidate] (244.064 ms) : 0, 244064
AppSec [baseline] (30.733 ms) : 0, 30733
AppSec [candidate] (30.587 ms) : 0, 30587
Debugger [baseline] (6.413 ms) : 0, 6413
Debugger [candidate] (6.468 ms) : 0, 6468
Remote Config [baseline] (696.129 µs) : 0, 696
Remote Config [candidate] (679.021 µs) : 0, 679
Telemetry [baseline] (16.66 ms) : 0, 16660
Telemetry [candidate] (13.133 ms) : 0, 13133
section iast
crashtracking [baseline] (1.471 ms) : 0, 1471
crashtracking [candidate] (1.468 ms) : 0, 1468
BytebuddyAgent [baseline] (860.77 ms) : 0, 860770
BytebuddyAgent [candidate] (865.799 ms) : 0, 865799
GlobalTracer [baseline] (248.349 ms) : 0, 248349
GlobalTracer [candidate] (235.89 ms) : 0, 235890
AppSec [baseline] (26.882 ms) : 0, 26882
AppSec [candidate] (30.881 ms) : 0, 30881
Debugger [baseline] (6.183 ms) : 0, 6183
Debugger [candidate] (6.955 ms) : 0, 6955
Remote Config [baseline] (631.849 µs) : 0, 632
Remote Config [candidate] (615.868 µs) : 0, 616
Telemetry [baseline] (8.463 ms) : 0, 8463
Telemetry [candidate] (8.434 ms) : 0, 8434
IAST [baseline] (27.734 ms) : 0, 27734
IAST [candidate] (27.333 ms) : 0, 27333
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/junit6-integration
git_commit_date 1757602568 1757613026
git_commit_sha fa49f3f 9cc5ae3
release_version 1.54.0-SNAPSHOT~fa49f3fb37 1.54.0-SNAPSHOT~9cc5ae37a5
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1757614499 1757614499
ci_job_id 1125288931 1125288931
ci_pipeline_id 76229086 76229086
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-f6z2efx7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-f6z2efx7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load better
[-919.138µs; -316.088µs] or [-6.384%; -2.195%]		 unstable
[-21.585op/s; +51.022op/s] or [-6.672%; +15.770%]		 13.780ms 338.250op/s 14.397ms 323.531op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-756.259µs; -338.913µs] or [-6.909%; -3.096%]		 unstable
[-29.079op/s; +73.329op/s] or [-6.846%; +17.263%]		 10.399ms 446.906op/s 10.946ms 424.781op/s
scenario:load:petclinic:appsec:high_load better
[-3.177ms; -2.245ms] or [-6.353%; -4.488%]		 unstable
[-1.494op/s; +12.119op/s] or [-1.596%; +12.948%]		 47.302ms 98.912op/s 50.013ms 93.600op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~9cc5ae37a5, baseline=1.54.0-SNAPSHOT~fa49f3fb37
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.491 ms) : 4438, 4543
.   : milestone, 4491,
iast (9.577 ms) : 9421, 9733
.   : milestone, 9577,
iast_FULL (14.397 ms) : 14111, 14684
.   : milestone, 14397,
iast_GLOBAL (10.946 ms) : 10752, 11141
.   : milestone, 10946,
profiling (8.897 ms) : 8751, 9043
.   : milestone, 8897,
tracing (7.526 ms) : 7418, 7634
.   : milestone, 7526,
section candidate
no_agent (4.531 ms) : 4478, 4584
.   : milestone, 4531,
iast (9.489 ms) : 9329, 9649
.   : milestone, 9489,
iast_FULL (13.78 ms) : 13506, 14053
.   : milestone, 13780,
iast_GLOBAL (10.399 ms) : 10206, 10592
.   : milestone, 10399,
profiling (8.795 ms) : 8654, 8936
.   : milestone, 8795,
tracing (7.571 ms) : 7465, 7677
.   : milestone, 7571,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.491 ms [4.438 ms, 4.543 ms] -
iast 9.577 ms [9.421 ms, 9.733 ms] 5.086 ms (113.3%)
iast_FULL 14.397 ms [14.111 ms, 14.684 ms] 9.907 ms (220.6%)
iast_GLOBAL 10.946 ms [10.752 ms, 11.141 ms] 6.455 ms (143.7%)
profiling 8.897 ms [8.751 ms, 9.043 ms] 4.406 ms (98.1%)
tracing 7.526 ms [7.418 ms, 7.634 ms] 3.035 ms (67.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.531 ms [4.478 ms, 4.584 ms] -
iast 9.489 ms [9.329 ms, 9.649 ms] 4.958 ms (109.4%)
iast_FULL 13.78 ms [13.506 ms, 14.053 ms] 9.248 ms (204.1%)
iast_GLOBAL 10.399 ms [10.206 ms, 10.592 ms] 5.867 ms (129.5%)
profiling 8.795 ms [8.654 ms, 8.936 ms] 4.264 ms (94.1%)
tracing 7.571 ms [7.465 ms, 7.677 ms] 3.04 ms (67.1%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~9cc5ae37a5, baseline=1.54.0-SNAPSHOT~fa49f3fb37
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.448 ms) : 37143, 37754
.   : milestone, 37448,
appsec (50.013 ms) : 49558, 50468
.   : milestone, 50013,
code_origins (45.911 ms) : 45500, 46323
.   : milestone, 45911,
iast (45.109 ms) : 44732, 45487
.   : milestone, 45109,
profiling (49.092 ms) : 48636, 49548
.   : milestone, 49092,
tracing (43.758 ms) : 43384, 44131
.   : milestone, 43758,
section candidate
no_agent (36.581 ms) : 36282, 36880
.   : milestone, 36581,
appsec (47.302 ms) : 46891, 47712
.   : milestone, 47302,
code_origins (44.932 ms) : 44539, 45324
.   : milestone, 44932,
iast (44.133 ms) : 43755, 44510
.   : milestone, 44133,
profiling (48.715 ms) : 48257, 49174
.   : milestone, 48715,
tracing (44.645 ms) : 44266, 45025
.   : milestone, 44645,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.448 ms [37.143 ms, 37.754 ms] -
appsec 50.013 ms [49.558 ms, 50.468 ms] 12.564 ms (33.6%)
code_origins 45.911 ms [45.5 ms, 46.323 ms] 8.463 ms (22.6%)
iast 45.109 ms [44.732 ms, 45.487 ms] 7.661 ms (20.5%)
profiling 49.092 ms [48.636 ms, 49.548 ms] 11.643 ms (31.1%)
tracing 43.758 ms [43.384 ms, 44.131 ms] 6.309 ms (16.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.581 ms [36.282 ms, 36.88 ms] -
appsec 47.302 ms [46.891 ms, 47.712 ms] 10.721 ms (29.3%)
code_origins 44.932 ms [44.539 ms, 45.324 ms] 8.35 ms (22.8%)
iast 44.133 ms [43.755 ms, 44.51 ms] 7.551 ms (20.6%)
profiling 48.715 ms [48.257 ms, 49.174 ms] 12.134 ms (33.2%)
tracing 44.645 ms [44.266 ms, 45.025 ms] 8.064 ms (22.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/junit6-integration
git_commit_date 1757602568 1757613026
git_commit_sha fa49f3f 9cc5ae3
release_version 1.54.0-SNAPSHOT~fa49f3fb37 1.54.0-SNAPSHOT~9cc5ae37a5
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1757615023 1757615023
ci_job_id 1125288932 1125288932
ci_pipeline_id 76229086 76229086
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-s7zdry6a 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-s7zdry6a 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 1 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.459ms; -1.119ms] or [-38.909%; -29.845%]		 2.461ms 3.751ms
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~9cc5ae37a5, baseline=1.54.0-SNAPSHOT~fa49f3fb37
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.575 s) : 15575000, 15575000
.   : milestone, 15575000,
appsec (14.804 s) : 14804000, 14804000
.   : milestone, 14804000,
iast (18.377 s) : 18377000, 18377000
.   : milestone, 18377000,
iast_GLOBAL (17.742 s) : 17742000, 17742000
.   : milestone, 17742000,
profiling (15.575 s) : 15575000, 15575000
.   : milestone, 15575000,
tracing (14.859 s) : 14859000, 14859000
.   : milestone, 14859000,
section candidate
no_agent (14.992 s) : 14992000, 14992000
.   : milestone, 14992000,
appsec (14.922 s) : 14922000, 14922000
.   : milestone, 14922000,
iast (18.562 s) : 18562000, 18562000
.   : milestone, 18562000,
iast_GLOBAL (18.035 s) : 18035000, 18035000
.   : milestone, 18035000,
profiling (15.317 s) : 15317000, 15317000
.   : milestone, 15317000,
tracing (15.137 s) : 15137000, 15137000
.   : milestone, 15137000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.575 s [15.575 s, 15.575 s] -
appsec 14.804 s [14.804 s, 14.804 s] -771.0 ms (-5.0%)
iast 18.377 s [18.377 s, 18.377 s] 2.802 s (18.0%)
iast_GLOBAL 17.742 s [17.742 s, 17.742 s] 2.167 s (13.9%)
profiling 15.575 s [15.575 s, 15.575 s] 0.0 µs (0.0%)
tracing 14.859 s [14.859 s, 14.859 s] -716.0 ms (-4.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.992 s [14.992 s, 14.992 s] -
appsec 14.922 s [14.922 s, 14.922 s] -70.0 ms (-0.5%)
iast 18.562 s [18.562 s, 18.562 s] 3.57 s (23.8%)
iast_GLOBAL 18.035 s [18.035 s, 18.035 s] 3.043 s (20.3%)
profiling 15.317 s [15.317 s, 15.317 s] 325.0 ms (2.2%)
tracing 15.137 s [15.137 s, 15.137 s] 145.0 ms (1.0%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~9cc5ae37a5, baseline=1.54.0-SNAPSHOT~fa49f3fb37
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.478 ms) : 1467, 1490
.   : milestone, 1478,
appsec (3.751 ms) : 3533, 3968
.   : milestone, 3751,
iast (2.212 ms) : 2149, 2275
.   : milestone, 2212,
iast_GLOBAL (2.252 ms) : 2188, 2315
.   : milestone, 2252,
profiling (2.062 ms) : 2010, 2114
.   : milestone, 2062,
tracing (2.03 ms) : 1981, 2079
.   : milestone, 2030,
section candidate
no_agent (1.477 ms) : 1465, 1489
.   : milestone, 1477,
appsec (2.461 ms) : 2411, 2512
.   : milestone, 2461,
iast (2.203 ms) : 2140, 2266
.   : milestone, 2203,
iast_GLOBAL (2.243 ms) : 2180, 2307
.   : milestone, 2243,
profiling (2.493 ms) : 2328, 2659
.   : milestone, 2493,
tracing (2.021 ms) : 1972, 2070
.   : milestone, 2021,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.467 ms, 1.49 ms] -
appsec 3.751 ms [3.533 ms, 3.968 ms] 2.272 ms (153.7%)
iast 2.212 ms [2.149 ms, 2.275 ms] 733.328 µs (49.6%)
iast_GLOBAL 2.252 ms [2.188 ms, 2.315 ms] 773.402 µs (52.3%)
profiling 2.062 ms [2.01 ms, 2.114 ms] 583.923 µs (39.5%)
tracing 2.03 ms [1.981 ms, 2.079 ms] 551.717 µs (37.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.489 ms] -
appsec 2.461 ms [2.411 ms, 2.512 ms] 984.181 µs (66.6%)
iast 2.203 ms [2.14 ms, 2.266 ms] 725.691 µs (49.1%)
iast_GLOBAL 2.243 ms [2.18 ms, 2.307 ms] 766.356 µs (51.9%)
profiling 2.493 ms [2.328 ms, 2.659 ms] 1.016 ms (68.8%)
tracing 2.021 ms [1.972 ms, 2.07 ms] 544.229 µs (36.8%)

@nikita-tkachenko-datadog nikita-tkachenko-datadog marked this pull request as ready for review September 11, 2025 19:06
@nikita-tkachenko-datadog nikita-tkachenko-datadog requested a review from a team as a code owner September 11, 2025 19:06
@nikita-tkachenko-datadog nikita-tkachenko-datadog merged commit f7ec25f into master Sep 11, 2025
506 checks passed
@nikita-tkachenko-datadog nikita-tkachenko-datadog deleted the nikita-tkachenko/junit6-integration branch September 11, 2025 19:08
@github-actions github-actions bot added this to the 1.54.0 milestone Sep 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

@Mariovido Mariovido Awaiting requested review from Mariovido Mariovido was automatically assigned from DataDog/ci-app-libraries-java

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.54.0

Development

Successfully merging this pull request may close these issues.

2 participants

@nikita-tkachenko-datadog @AlexeyKuznetsov-DD