Migrate tests and `ConfigInversionMetricCollector` to `config-utils` module #9566

mhlidd · 2025-09-18T22:03:37Z

What Does This Do

This PR migrates the tests from the classes in #9426 to config-utils, and migrates an abstracted version of ConfigInversionMetricCollector to config-utils while keeping the implementation in internal-api. This way, the telemetry can be used in config-utils but still registered within the Config object.

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-09-18T22:39:03Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/migrate_config-utils_tests
git_commit_date	1758729907	1758739264
git_commit_sha	`1450a11`	`8fd87fb`
release_version	1.54.0-SNAPSHOT~1450a11e5d	1.54.0-SNAPSHOT~8fd87fbedd

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1758740937	1758740937
ci_job_id	1146265740	1146265740
ci_pipeline_id	77459015	77459015
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-sljyl2mz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-sljyl2mz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 4 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~8fd87fbedd, baseline=1.54.0-SNAPSHOT~1450a11e5d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.015 s) : 0, 1015050
Total [baseline] (8.672 s) : 0, 8671811
Agent [candidate] (1.009 s) : 0, 1009430
Total [candidate] (8.737 s) : 0, 8737297
section iast
Agent [baseline] (1.159 s) : 0, 1159149
Total [baseline] (9.252 s) : 0, 9252100
Agent [candidate] (1.156 s) : 0, 1156321
Total [candidate] (9.338 s) : 0, 9337631

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.015 s	-
Agent	iast	1.159 s	144.098 ms (14.2%)
Total	tracing	8.672 s	-
Total	iast	9.252 s	580.288 ms (6.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.009 s	-
Agent	iast	1.156 s	146.891 ms (14.6%)
Total	tracing	8.737 s	-
Total	iast	9.338 s	600.333 ms (6.9%)

gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~8fd87fbedd, baseline=1.54.0-SNAPSHOT~1450a11e5d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.47 ms) : 0, 1470
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (694.997 ms) : 0, 694997
BytebuddyAgent [candidate] (690.927 ms) : 0, 690927
GlobalTracer [baseline] (249.862 ms) : 0, 249862
GlobalTracer [candidate] (248.714 ms) : 0, 248714
AppSec [baseline] (31.3 ms) : 0, 31300
AppSec [candidate] (31.112 ms) : 0, 31112
Debugger [baseline] (6.464 ms) : 0, 6464
Debugger [candidate] (6.369 ms) : 0, 6369
Remote Config [baseline] (695.28 µs) : 0, 695
Remote Config [candidate] (690.278 µs) : 0, 690
Telemetry [baseline] (9.06 ms) : 0, 9060
Telemetry [candidate] (9.012 ms) : 0, 9012
section iast
crashtracking [baseline] (1.475 ms) : 0, 1475
crashtracking [candidate] (1.481 ms) : 0, 1481
BytebuddyAgent [baseline] (820.121 ms) : 0, 820121
BytebuddyAgent [candidate] (819.121 ms) : 0, 819121
GlobalTracer [baseline] (240.051 ms) : 0, 240051
GlobalTracer [candidate] (238.609 ms) : 0, 238609
AppSec [baseline] (34.277 ms) : 0, 34277
AppSec [candidate] (34.038 ms) : 0, 34038
Debugger [baseline] (6.149 ms) : 0, 6149
Debugger [candidate] (6.109 ms) : 0, 6109
Remote Config [baseline] (625.131 µs) : 0, 625
Remote Config [candidate] (596.833 µs) : 0, 597
Telemetry [baseline] (8.52 ms) : 0, 8520
Telemetry [candidate] (8.469 ms) : 0, 8469
IAST [baseline] (26.513 ms) : 0, 26513
IAST [candidate] (26.477 ms) : 0, 26477

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~8fd87fbedd, baseline=1.54.0-SNAPSHOT~1450a11e5d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.007 s) : 0, 1007336
Total [baseline] (10.759 s) : 0, 10759419
Agent [candidate] (1.009 s) : 0, 1008920
Total [candidate] (10.663 s) : 0, 10662653
section appsec
Agent [baseline] (1.192 s) : 0, 1191833
Total [baseline] (10.966 s) : 0, 10965738
Agent [candidate] (1.188 s) : 0, 1188125
Total [candidate] (11.053 s) : 0, 11052717
section iast
Agent [baseline] (1.144 s) : 0, 1144336
Total [baseline] (10.938 s) : 0, 10938007
Agent [candidate] (1.145 s) : 0, 1145401
Total [candidate] (10.988 s) : 0, 10987636
section profiling
Agent [baseline] (1.159 s) : 0, 1158613
Total [baseline] (11.171 s) : 0, 11171019
Agent [candidate] (1.154 s) : 0, 1153956
Total [candidate] (11.072 s) : 0, 11071523

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.007 s	-
Agent	appsec	1.192 s	184.496 ms (18.3%)
Agent	iast	1.144 s	136.999 ms (13.6%)
Agent	profiling	1.159 s	151.277 ms (15.0%)
Total	tracing	10.759 s	-
Total	appsec	10.966 s	206.32 ms (1.9%)
Total	iast	10.938 s	178.589 ms (1.7%)
Total	profiling	11.171 s	411.6 ms (3.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.009 s	-
Agent	appsec	1.188 s	179.205 ms (17.8%)
Agent	iast	1.145 s	136.481 ms (13.5%)
Agent	profiling	1.154 s	145.036 ms (14.4%)
Total	tracing	10.663 s	-
Total	appsec	11.053 s	390.064 ms (3.7%)
Total	iast	10.988 s	324.983 ms (3.0%)
Total	profiling	11.072 s	408.87 ms (3.8%)

gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~8fd87fbedd, baseline=1.54.0-SNAPSHOT~1450a11e5d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.467 ms) : 0, 1467
BytebuddyAgent [baseline] (689.548 ms) : 0, 689548
BytebuddyAgent [candidate] (691.322 ms) : 0, 691322
GlobalTracer [baseline] (248.203 ms) : 0, 248203
GlobalTracer [candidate] (248.298 ms) : 0, 248298
AppSec [baseline] (30.894 ms) : 0, 30894
AppSec [candidate] (30.697 ms) : 0, 30697
Debugger [baseline] (6.372 ms) : 0, 6372
Debugger [candidate] (6.342 ms) : 0, 6342
Remote Config [baseline] (679.897 µs) : 0, 680
Remote Config [candidate] (678.576 µs) : 0, 679
Telemetry [baseline] (9.009 ms) : 0, 9009
Telemetry [candidate] (8.941 ms) : 0, 8941
section appsec
crashtracking [baseline] (1.469 ms) : 0, 1469
crashtracking [candidate] (1.45 ms) : 0, 1450
BytebuddyAgent [baseline] (714.619 ms) : 0, 714619
BytebuddyAgent [candidate] (711.996 ms) : 0, 711996
GlobalTracer [baseline] (240.995 ms) : 0, 240995
GlobalTracer [candidate] (241.035 ms) : 0, 241035
AppSec [baseline] (171.486 ms) : 0, 171486
AppSec [candidate] (170.902 ms) : 0, 170902
Debugger [baseline] (6.041 ms) : 0, 6041
Debugger [candidate] (6.832 ms) : 0, 6832
Remote Config [baseline] (647.343 µs) : 0, 647
Remote Config [candidate] (647.644 µs) : 0, 648
Telemetry [baseline] (10.659 ms) : 0, 10659
Telemetry [candidate] (9.257 ms) : 0, 9257
IAST [baseline] (24.724 ms) : 0, 24724
IAST [candidate] (24.844 ms) : 0, 24844
section iast
crashtracking [baseline] (1.463 ms) : 0, 1463
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (809.668 ms) : 0, 809668
BytebuddyAgent [candidate] (810.253 ms) : 0, 810253
GlobalTracer [baseline] (236.855 ms) : 0, 236855
GlobalTracer [candidate] (237.68 ms) : 0, 237680
AppSec [baseline] (33.96 ms) : 0, 33960
AppSec [candidate] (33.63 ms) : 0, 33630
Debugger [baseline] (6.074 ms) : 0, 6074
Debugger [candidate] (5.998 ms) : 0, 5998
Remote Config [baseline] (596.244 µs) : 0, 596
Remote Config [candidate] (583.514 µs) : 0, 584
Telemetry [baseline] (8.218 ms) : 0, 8218
Telemetry [candidate] (8.241 ms) : 0, 8241
IAST [baseline] (26.093 ms) : 0, 26093
IAST [candidate] (26.129 ms) : 0, 26129
section profiling
crashtracking [baseline] (1.45 ms) : 0, 1450
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (722.619 ms) : 0, 722619
BytebuddyAgent [candidate] (719.307 ms) : 0, 719307
GlobalTracer [baseline] (224.937 ms) : 0, 224937
GlobalTracer [candidate] (224.744 ms) : 0, 224744
AppSec [baseline] (31.663 ms) : 0, 31663
AppSec [candidate] (31.403 ms) : 0, 31403
Debugger [baseline] (8.191 ms) : 0, 8191
Debugger [candidate] (6.554 ms) : 0, 6554
Remote Config [baseline] (732.522 µs) : 0, 733
Remote Config [candidate] (697.469 µs) : 0, 697
Telemetry [baseline] (14.894 ms) : 0, 14894
Telemetry [candidate] (16.117 ms) : 0, 16117
ProfilingAgent [baseline] (102.022 ms) : 0, 102022
ProfilingAgent [candidate] (101.261 ms) : 0, 101261
Profiling [baseline] (102.644 ms) : 0, 102644
Profiling [candidate] (101.86 ms) : 0, 101860

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/migrate_config-utils_tests
git_commit_date	1758729907	1758739264
git_commit_sha	`1450a11`	`8fd87fb`
release_version	1.54.0-SNAPSHOT~1450a11e5d	1.54.0-SNAPSHOT~8fd87fbedd

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1758740681	1758740681
ci_job_id	1146265741	1146265741
ci_pipeline_id	77459015	77459015
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-pkfkdodt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-pkfkdodt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 3 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:tracing:high_load	worse [+588.626µs; +841.428µs] or [+7.872%; +11.253%]	unstable [-130.765op/s; +24.078op/s] or [-21.118%; +3.888%]	8.192ms	565.875op/s	7.477ms	619.219op/s
scenario:load:petclinic:iast:high_load	worse [+2.146ms; +2.956ms] or [+4.964%; +6.835%]	unstable [-10.662op/s; +3.979op/s] or [-9.856%; +3.678%]	45.795ms	104.833op/s	43.244ms	108.175op/s
scenario:load:petclinic:profiling:high_load	better [-2.956ms; -1.985ms] or [-6.148%; -4.129%]	unstable [-1.120op/s; +14.168op/s] or [-1.150%; +14.548%]	45.612ms	103.911op/s	48.083ms	97.388op/s
scenario:load:petclinic:code_origins:high_load	worse [+1.919ms; +2.747ms] or [+4.406%; +6.305%]	unstable [-11.803op/s; +3.560op/s] or [-10.988%; +3.314%]	45.894ms	103.291op/s	43.561ms	107.412op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~8fd87fbedd, baseline=1.54.0-SNAPSHOT~1450a11e5d
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.364 ms) : 4309, 4420
.   : milestone, 4364,
iast (9.156 ms) : 9006, 9305
.   : milestone, 9156,
iast_FULL (14.0 ms) : 13721, 14279
.   : milestone, 14000,
iast_GLOBAL (10.857 ms) : 10658, 11056
.   : milestone, 10857,
profiling (8.95 ms) : 8811, 9089
.   : milestone, 8950,
tracing (7.477 ms) : 7366, 7589
.   : milestone, 7477,
section candidate
no_agent (4.258 ms) : 4211, 4305
.   : milestone, 4258,
iast (9.48 ms) : 9323, 9637
.   : milestone, 9480,
iast_FULL (13.924 ms) : 13653, 14196
.   : milestone, 13924,
iast_GLOBAL (10.892 ms) : 10694, 11090
.   : milestone, 10892,
profiling (9.017 ms) : 8878, 9156
.   : milestone, 9017,
tracing (8.192 ms) : 8069, 8315
.   : milestone, 8192,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.364 ms [4.309 ms, 4.42 ms]	-
iast	9.156 ms [9.006 ms, 9.305 ms]	4.791 ms (109.8%)
iast_FULL	14.0 ms [13.721 ms, 14.279 ms]	9.636 ms (220.8%)
iast_GLOBAL	10.857 ms [10.658 ms, 11.056 ms]	6.493 ms (148.8%)
profiling	8.95 ms [8.811 ms, 9.089 ms]	4.585 ms (105.1%)
tracing	7.477 ms [7.366 ms, 7.589 ms]	3.113 ms (71.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.258 ms [4.211 ms, 4.305 ms]	-
iast	9.48 ms [9.323 ms, 9.637 ms]	5.222 ms (122.6%)
iast_FULL	13.924 ms [13.653 ms, 14.196 ms]	9.666 ms (227.0%)
iast_GLOBAL	10.892 ms [10.694 ms, 11.09 ms]	6.634 ms (155.8%)
profiling	9.017 ms [8.878 ms, 9.156 ms]	4.759 ms (111.8%)
tracing	8.192 ms [8.069 ms, 8.315 ms]	3.934 ms (92.4%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~8fd87fbedd, baseline=1.54.0-SNAPSHOT~1450a11e5d
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.627 ms) : 36325, 36929
.   : milestone, 36627,
appsec (48.551 ms) : 48124, 48978
.   : milestone, 48551,
code_origins (43.561 ms) : 43181, 43941
.   : milestone, 43561,
iast (43.244 ms) : 42881, 43606
.   : milestone, 43244,
profiling (48.083 ms) : 47607, 48560
.   : milestone, 48083,
tracing (45.501 ms) : 45118, 45884
.   : milestone, 45501,
section candidate
no_agent (36.635 ms) : 36333, 36938
.   : milestone, 36635,
appsec (49.041 ms) : 48604, 49478
.   : milestone, 49041,
code_origins (45.894 ms) : 45505, 46283
.   : milestone, 45894,
iast (45.795 ms) : 45406, 46184
.   : milestone, 45795,
profiling (45.612 ms) : 45188, 46036
.   : milestone, 45612,
tracing (44.332 ms) : 43957, 44706
.   : milestone, 44332,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.627 ms [36.325 ms, 36.929 ms]	-
appsec	48.551 ms [48.124 ms, 48.978 ms]	11.924 ms (32.6%)
code_origins	43.561 ms [43.181 ms, 43.941 ms]	6.934 ms (18.9%)
iast	43.244 ms [42.881 ms, 43.606 ms]	6.617 ms (18.1%)
profiling	48.083 ms [47.607 ms, 48.56 ms]	11.456 ms (31.3%)
tracing	45.501 ms [45.118 ms, 45.884 ms]	8.874 ms (24.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.635 ms [36.333 ms, 36.938 ms]	-
appsec	49.041 ms [48.604 ms, 49.478 ms]	12.406 ms (33.9%)
code_origins	45.894 ms [45.505 ms, 46.283 ms]	9.259 ms (25.3%)
iast	45.795 ms [45.406 ms, 46.184 ms]	9.159 ms (25.0%)
profiling	45.612 ms [45.188 ms, 46.036 ms]	8.977 ms (24.5%)
tracing	44.332 ms [43.957 ms, 44.706 ms]	7.696 ms (21.0%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/migrate_config-utils_tests
git_commit_date	1758729907	1758739264
git_commit_sha	`1450a11`	`8fd87fb`
release_version	1.54.0-SNAPSHOT~1450a11e5d	1.54.0-SNAPSHOT~8fd87fbedd

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1758741129	1758741129
ci_job_id	1146265742	1146265742
ci_pipeline_id	77459015	77459015
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-6jnxk9ch 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-6jnxk9ch 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~8fd87fbedd, baseline=1.54.0-SNAPSHOT~1450a11e5d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (3.672 ms) : 3456, 3888
.   : milestone, 3672,
iast (2.201 ms) : 2138, 2264
.   : milestone, 2201,
iast_GLOBAL (2.234 ms) : 2171, 2298
.   : milestone, 2234,
profiling (2.051 ms) : 1999, 2103
.   : milestone, 2051,
tracing (2.012 ms) : 1964, 2061
.   : milestone, 2012,
section candidate
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.615 ms) : 3403, 3827
.   : milestone, 3615,
iast (2.203 ms) : 2140, 2266
.   : milestone, 2203,
iast_GLOBAL (2.234 ms) : 2170, 2297
.   : milestone, 2234,
profiling (2.057 ms) : 2005, 2109
.   : milestone, 2057,
tracing (2.006 ms) : 1957, 2055
.   : milestone, 2006,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.463 ms, 1.486 ms]	-
appsec	3.672 ms [3.456 ms, 3.888 ms]	2.198 ms (149.1%)
iast	2.201 ms [2.138 ms, 2.264 ms]	726.898 µs (49.3%)
iast_GLOBAL	2.234 ms [2.171 ms, 2.298 ms]	760.127 µs (51.6%)
profiling	2.051 ms [1.999 ms, 2.103 ms]	577.105 µs (39.1%)
tracing	2.012 ms [1.964 ms, 2.061 ms]	538.299 µs (36.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.462 ms, 1.485 ms]	-
appsec	3.615 ms [3.403 ms, 3.827 ms]	2.141 ms (145.3%)
iast	2.203 ms [2.14 ms, 2.266 ms]	729.434 µs (49.5%)
iast_GLOBAL	2.234 ms [2.17 ms, 2.297 ms]	760.047 µs (51.6%)
profiling	2.057 ms [2.005 ms, 2.109 ms]	583.185 µs (39.6%)
tracing	2.006 ms [1.957 ms, 2.055 ms]	532.629 µs (36.1%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~8fd87fbedd, baseline=1.54.0-SNAPSHOT~1450a11e5d
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.404 s) : 15404000, 15404000
.   : milestone, 15404000,
appsec (15.045 s) : 15045000, 15045000
.   : milestone, 15045000,
iast (18.682 s) : 18682000, 18682000
.   : milestone, 18682000,
iast_GLOBAL (18.046 s) : 18046000, 18046000
.   : milestone, 18046000,
profiling (15.45 s) : 15450000, 15450000
.   : milestone, 15450000,
tracing (15.166 s) : 15166000, 15166000
.   : milestone, 15166000,
section candidate
no_agent (15.513 s) : 15513000, 15513000
.   : milestone, 15513000,
appsec (15.272 s) : 15272000, 15272000
.   : milestone, 15272000,
iast (18.692 s) : 18692000, 18692000
.   : milestone, 18692000,
iast_GLOBAL (18.075 s) : 18075000, 18075000
.   : milestone, 18075000,
profiling (15.175 s) : 15175000, 15175000
.   : milestone, 15175000,
tracing (15.308 s) : 15308000, 15308000
.   : milestone, 15308000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.404 s [15.404 s, 15.404 s]	-
appsec	15.045 s [15.045 s, 15.045 s]	-359.0 ms (-2.3%)
iast	18.682 s [18.682 s, 18.682 s]	3.278 s (21.3%)
iast_GLOBAL	18.046 s [18.046 s, 18.046 s]	2.642 s (17.2%)
profiling	15.45 s [15.45 s, 15.45 s]	46.0 ms (0.3%)
tracing	15.166 s [15.166 s, 15.166 s]	-238.0 ms (-1.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.513 s [15.513 s, 15.513 s]	-
appsec	15.272 s [15.272 s, 15.272 s]	-241.0 ms (-1.6%)
iast	18.692 s [18.692 s, 18.692 s]	3.179 s (20.5%)
iast_GLOBAL	18.075 s [18.075 s, 18.075 s]	2.562 s (16.5%)
profiling	15.175 s [15.175 s, 15.175 s]	-338.0 ms (-2.2%)
tracing	15.308 s [15.308 s, 15.308 s]	-205.0 ms (-1.3%)

datadog-datadog-prod-us1 · 2025-09-23T21:37:54Z

🎯 Code Coverage
• Patch Coverage: 42.86%
• Total Coverage: 57.86% (-1.96%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 8fd87fb | Docs | Was this helpful? Give us feedback!}

utils/config-utils/build.gradle.kts

…module (#9566) * adding supported-configurations.json file * migrating config-utils tests and ConfigInversionMetric telemetry * updating coverage and native image test * removing extra supported-configurations.json * adding dependency * updating excluded class coverage

mhlidd changed the base branch from master to mhlidd/config_inversion_plugins September 18, 2025 22:03

mhlidd added type: enhancement Enhancements and improvements comp: api Tracer public API labels Sep 19, 2025

mhlidd marked this pull request as ready for review September 19, 2025 00:32

mhlidd requested review from a team as code owners September 19, 2025 00:32

mhlidd requested review from PerfectSlayer and mcculls and removed request for a team September 19, 2025 00:32

This was referenced Sep 23, 2025

Implement Config Inversion with Default Strictness of Warning #9539

Merged

Adding Gradle Plugins for Config Inversion #9565

Merged

Base automatically changed from mhlidd/config_inversion_plugins to master September 23, 2025 18:31

mhlidd added 3 commits September 23, 2025 14:01

adding supported-configurations.json file

c232d57

migrating config-utils tests and ConfigInversionMetric telemetry

295cbee

updating coverage and native image test

1574d9b

mhlidd force-pushed the mhlidd/migrate_config-utils_tests branch from 57483a2 to 1574d9b Compare September 23, 2025 21:02

mhlidd added 2 commits September 23, 2025 14:04

removing extra supported-configurations.json

e91b965

adding dependency

16b9315

PerfectSlayer approved these changes Sep 24, 2025

View reviewed changes

utils/config-utils/build.gradle.kts Show resolved Hide resolved

mhlidd added 2 commits September 24, 2025 08:56

Merge branch 'master' into mhlidd/migrate_config-utils_tests

cf7074b

updating excluded class coverage

c8a466c

mhlidd enabled auto-merge (squash) September 24, 2025 18:14

Merge branch 'master' into mhlidd/migrate_config-utils_tests

8fd87fb

mhlidd merged commit 9ac9a56 into master Sep 24, 2025
544 checks passed

mhlidd deleted the mhlidd/migrate_config-utils_tests branch September 24, 2025 19:32

github-actions bot added this to the 1.54.0 milestone Sep 24, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

Migrate tests and `ConfigInversionMetricCollector` to `config-utils` module #9566

Migrate tests and `ConfigInversionMetricCollector` to `config-utils` module #9566

Uh oh!

mhlidd commented Sep 18, 2025

Uh oh!

pr-commenter bot commented Sep 18, 2025 •

edited

Loading

Uh oh!

datadog-datadog-prod-us1 bot commented Sep 23, 2025 •

edited by datadog-official bot

Loading

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Migrate tests and ConfigInversionMetricCollector to config-utils module #9566

Migrate tests and ConfigInversionMetricCollector to config-utils module #9566

Uh oh!

Conversation

mhlidd commented Sep 18, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Sep 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

datadog-datadog-prod-us1 bot commented Sep 23, 2025 • edited by datadog-official bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Migrate tests and `ConfigInversionMetricCollector` to `config-utils` module #9566

Migrate tests and `ConfigInversionMetricCollector` to `config-utils` module #9566

pr-commenter bot commented Sep 18, 2025 •

edited

Loading

datadog-datadog-prod-us1 bot commented Sep 23, 2025 •

edited by datadog-official bot

Loading