Use dynamic child pipelines for CiVis test environment trigger #9814

daniel-mohedano · 2025-10-21T09:19:49Z

What Does This Do

Modifies the trigger approach to use Dynamic Child Pipelines.
The CI state is now the following:
- ci-visibility-tests-check - Executes the .gitlab/ci_visibility_generate_job.sh script which will check if a GitHub PR is opened for the current branch and, if so, will check for comp: ci visibility in its labels. If both checks pass, it dynamically generates the .yml with a ci-visibility-test-environment job. If any of the checks don't pass, the generated .yml contains a noop job skip-ci-visibility-tests. This job won't be configured and executed in master and release/* branches.
- ci-visibility-tests-trigger - Uses the dynamically generated ci-visibility-test-environment.yml as a trigger job. The strategy: depend configuration means that it will wait for the downstream pipeline to finish and mimic its status (passed or failed).
All the jobs are now configured in the ci-visibility-tests stage for clarity.

Motivation

This new approach allows to dynamically configure if the test environment pipeline should run or not without depending on configuring this conditional with check-ci-visibility-label passing or not. Even when the check worked correctly, the failed job could cause confusion, especially for developers not familiar with the logic.

Additional Notes

Tested examples:

Pipeline without label - https://gitlab.ddbuild.io/DataDog/apm-reliability/dd-trace-java/-/pipelines/80185282 - The generated trigger job is the noop which automatically passes.
Pipeline with label - https://gitlab.ddbuild.io/DataDog/apm-reliability/dd-trace-java/-/pipelines/80196334 - The generated trigger job executes the test-environment tests.
Pipeline with label and failing test environment jobs - https://gitlab.ddbuild.io/DataDog/apm-reliability/dd-trace-java/-/pipelines/80191570 - When the test environment tests are executed and fail, the default-pipeline is marked as failed too, blocking the merge.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: SDTEST-2768

datadog-datadog-prod-us1 · 2025-10-21T09:38:28Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.65% (-0.05%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: e996b7c | Docs | Was this helpful? Give us feedback!}

pr-commenter · 2025-10-21T10:22:45Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/fix-trigger-test-env
git_commit_date	1761260114	1761301500
git_commit_sha	`f296927`	`e996b7c`
release_version	1.55.0-SNAPSHOT~f296927f57	1.55.0-SNAPSHOT~e996b7c000

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1761303391	1761303391
ci_job_id	1195811598	1195811598
ci_pipeline_id	80196334	80196334
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-71ssvkf1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-71ssvkf1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 12 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~e996b7c000, baseline=1.55.0-SNAPSHOT~f296927f57

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.032 s) : 0, 1032128
Total [baseline] (10.811 s) : 0, 10810602
Agent [candidate] (1.029 s) : 0, 1029124
Total [candidate] (10.933 s) : 0, 10932819
section appsec
Agent [baseline] (1.204 s) : 0, 1203731
Total [baseline] (10.954 s) : 0, 10954321
Agent [candidate] (1.219 s) : 0, 1219156
Total [candidate] (11.087 s) : 0, 11087021
section iast
Agent [baseline] (1.163 s) : 0, 1163223
Total [baseline] (11.176 s) : 0, 11175573
Agent [candidate] (1.164 s) : 0, 1163511
Total [candidate] (11.178 s) : 0, 11178405
section profiling
Agent [baseline] (1.174 s) : 0, 1173950
Total [baseline] (10.92 s) : 0, 10919720
Agent [candidate] (1.181 s) : 0, 1181054
Total [candidate] (10.992 s) : 0, 10991556

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.032 s	-
Agent	appsec	1.204 s	171.603 ms (16.6%)
Agent	iast	1.163 s	131.096 ms (12.7%)
Agent	profiling	1.174 s	141.822 ms (13.7%)
Total	tracing	10.811 s	-
Total	appsec	10.954 s	143.719 ms (1.3%)
Total	iast	11.176 s	364.971 ms (3.4%)
Total	profiling	10.92 s	109.118 ms (1.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.029 s	-
Agent	appsec	1.219 s	190.033 ms (18.5%)
Agent	iast	1.164 s	134.387 ms (13.1%)
Agent	profiling	1.181 s	151.93 ms (14.8%)
Total	tracing	10.933 s	-
Total	appsec	11.087 s	154.202 ms (1.4%)
Total	iast	11.178 s	245.586 ms (2.2%)
Total	profiling	10.992 s	58.737 ms (0.5%)

gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~e996b7c000, baseline=1.55.0-SNAPSHOT~f296927f57

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.457 ms) : 0, 1457
crashtracking [candidate] (1.47 ms) : 0, 1470
BytebuddyAgent [baseline] (703.949 ms) : 0, 703949
BytebuddyAgent [candidate] (701.772 ms) : 0, 701772
GlobalTracer [baseline] (245.194 ms) : 0, 245194
GlobalTracer [candidate] (244.69 ms) : 0, 244690
AppSec [baseline] (32.409 ms) : 0, 32409
AppSec [candidate] (32.144 ms) : 0, 32144
Debugger [baseline] (6.402 ms) : 0, 6402
Debugger [candidate] (6.383 ms) : 0, 6383
Remote Config [baseline] (679.603 µs) : 0, 680
Remote Config [candidate] (668.606 µs) : 0, 669
Telemetry [baseline] (14.47 ms) : 0, 14470
Telemetry [candidate] (15.147 ms) : 0, 15147
Flare Poller [baseline] (6.345 ms) : 0, 6345
Flare Poller [candidate] (5.736 ms) : 0, 5736
section appsec
crashtracking [baseline] (1.472 ms) : 0, 1472
crashtracking [candidate] (1.477 ms) : 0, 1477
BytebuddyAgent [baseline] (726.777 ms) : 0, 726777
BytebuddyAgent [candidate] (736.987 ms) : 0, 736987
GlobalTracer [baseline] (236.191 ms) : 0, 236191
GlobalTracer [candidate] (239.347 ms) : 0, 239347
IAST [baseline] (25.009 ms) : 0, 25009
IAST [candidate] (25.406 ms) : 0, 25406
AppSec [baseline] (174.442 ms) : 0, 174442
AppSec [candidate] (175.374 ms) : 0, 175374
Debugger [baseline] (5.871 ms) : 0, 5871
Debugger [candidate] (6.033 ms) : 0, 6033
Remote Config [baseline] (623.985 µs) : 0, 624
Remote Config [candidate] (650.203 µs) : 0, 650
Telemetry [baseline] (8.386 ms) : 0, 8386
Telemetry [candidate] (8.638 ms) : 0, 8638
Flare Poller [baseline] (3.888 ms) : 0, 3888
Flare Poller [candidate] (3.964 ms) : 0, 3964
section iast
crashtracking [baseline] (1.475 ms) : 0, 1475
crashtracking [candidate] (1.473 ms) : 0, 1473
BytebuddyAgent [baseline] (825.238 ms) : 0, 825238
BytebuddyAgent [candidate] (825.302 ms) : 0, 825302
GlobalTracer [baseline] (234.628 ms) : 0, 234628
GlobalTracer [candidate] (234.931 ms) : 0, 234931
IAST [baseline] (34.195 ms) : 0, 34195
IAST [candidate] (33.312 ms) : 0, 33312
AppSec [baseline] (27.259 ms) : 0, 27259
AppSec [candidate] (27.893 ms) : 0, 27893
Debugger [baseline] (6.15 ms) : 0, 6150
Debugger [candidate] (6.111 ms) : 0, 6111
Remote Config [baseline] (610.376 µs) : 0, 610
Remote Config [candidate] (593.419 µs) : 0, 593
Telemetry [baseline] (8.375 ms) : 0, 8375
Telemetry [candidate] (8.47 ms) : 0, 8470
Flare Poller [baseline] (4.065 ms) : 0, 4065
Flare Poller [candidate] (4.103 ms) : 0, 4103
section profiling
crashtracking [baseline] (1.471 ms) : 0, 1471
crashtracking [candidate] (1.467 ms) : 0, 1467
BytebuddyAgent [baseline] (727.109 ms) : 0, 727109
BytebuddyAgent [candidate] (731.251 ms) : 0, 731251
GlobalTracer [baseline] (220.501 ms) : 0, 220501
GlobalTracer [candidate] (221.766 ms) : 0, 221766
AppSec [baseline] (32.246 ms) : 0, 32246
AppSec [candidate] (32.327 ms) : 0, 32327
Debugger [baseline] (11.406 ms) : 0, 11406
Debugger [candidate] (12.325 ms) : 0, 12325
Remote Config [baseline] (1.476 ms) : 0, 1476
Remote Config [candidate] (715.913 µs) : 0, 716
Telemetry [baseline] (10.71 ms) : 0, 10710
Telemetry [candidate] (10.58 ms) : 0, 10580
Flare Poller [baseline] (4.117 ms) : 0, 4117
Flare Poller [candidate] (4.21 ms) : 0, 4210
ProfilingAgent [baseline] (109.568 ms) : 0, 109568
ProfilingAgent [candidate] (110.768 ms) : 0, 110768
Profiling [baseline] (110.205 ms) : 0, 110205
Profiling [candidate] (111.435 ms) : 0, 111435

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~e996b7c000, baseline=1.55.0-SNAPSHOT~f296927f57

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1046617
Total [baseline] (8.728 s) : 0, 8727619
Agent [candidate] (1.033 s) : 0, 1033262
Total [candidate] (8.722 s) : 0, 8722277
section iast
Agent [baseline] (1.164 s) : 0, 1164181
Total [baseline] (9.381 s) : 0, 9381262
Agent [candidate] (1.164 s) : 0, 1163997
Total [candidate] (9.422 s) : 0, 9421830

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.047 s	-
Agent	iast	1.164 s	117.564 ms (11.2%)
Total	tracing	8.728 s	-
Total	iast	9.381 s	653.643 ms (7.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.033 s	-
Agent	iast	1.164 s	130.734 ms (12.7%)
Total	tracing	8.722 s	-
Total	iast	9.422 s	699.553 ms (8.0%)

gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~e996b7c000, baseline=1.55.0-SNAPSHOT~f296927f57

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.49 ms) : 0, 1490
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (713.737 ms) : 0, 713737
BytebuddyAgent [candidate] (704.954 ms) : 0, 704954
GlobalTracer [baseline] (248.216 ms) : 0, 248216
GlobalTracer [candidate] (245.876 ms) : 0, 245876
AppSec [baseline] (32.984 ms) : 0, 32984
AppSec [candidate] (32.424 ms) : 0, 32424
Debugger [baseline] (6.515 ms) : 0, 6515
Debugger [candidate] (6.41 ms) : 0, 6410
Remote Config [baseline] (695.365 µs) : 0, 695
Remote Config [candidate] (681.811 µs) : 0, 682
Telemetry [baseline] (13.105 ms) : 0, 13105
Telemetry [candidate] (14.517 ms) : 0, 14517
Flare Poller [baseline] (8.299 ms) : 0, 8299
Flare Poller [candidate] (5.771 ms) : 0, 5771
section iast
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.488 ms) : 0, 1488
BytebuddyAgent [baseline] (824.843 ms) : 0, 824843
BytebuddyAgent [candidate] (825.621 ms) : 0, 825621
GlobalTracer [baseline] (235.397 ms) : 0, 235397
GlobalTracer [candidate] (234.415 ms) : 0, 234415
AppSec [baseline] (29.882 ms) : 0, 29882
AppSec [candidate] (29.964 ms) : 0, 29964
Debugger [baseline] (6.091 ms) : 0, 6091
Debugger [candidate] (6.078 ms) : 0, 6078
Remote Config [baseline] (609.213 µs) : 0, 609
Remote Config [candidate] (620.613 µs) : 0, 621
Telemetry [baseline] (8.52 ms) : 0, 8520
Telemetry [candidate] (8.437 ms) : 0, 8437
Flare Poller [baseline] (4.162 ms) : 0, 4162
Flare Poller [candidate] (4.156 ms) : 0, 4156
IAST [baseline] (31.853 ms) : 0, 31853
IAST [candidate] (31.89 ms) : 0, 31890

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/fix-trigger-test-env
git_commit_date	1761260114	1761301500
git_commit_sha	`f296927`	`e996b7c`
release_version	1.55.0-SNAPSHOT~f296927f57	1.55.0-SNAPSHOT~e996b7c000

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1761303049	1761303049
ci_job_id	1195811599	1195811599
ci_pipeline_id	80196334	80196334
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-rc2jyxu9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-rc2jyxu9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:tracing:high_load	worse [+286.718µs; +540.878µs] or [+3.649%; +6.884%]	unstable [-99.417op/s; +41.479op/s] or [-16.862%; +7.035%]	8.271ms	560.625op/s	7.857ms	589.594op/s
scenario:load:insecure-bank:iast:high_load	better [-713.857µs; -342.438µs] or [-6.946%; -3.332%]	unstable [-29.311op/s; +77.686op/s] or [-6.481%; +17.178%]	9.750ms	476.438op/s	10.278ms	452.250op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~e996b7c000, baseline=1.55.0-SNAPSHOT~f296927f57
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.963 ms) : 36662, 37264
.   : milestone, 36963,
appsec (47.257 ms) : 46845, 47670
.   : milestone, 47257,
code_origins (43.553 ms) : 43171, 43935
.   : milestone, 43553,
iast (45.321 ms) : 44915, 45728
.   : milestone, 45321,
profiling (47.207 ms) : 46749, 47664
.   : milestone, 47207,
tracing (43.594 ms) : 43226, 43962
.   : milestone, 43594,
section candidate
no_agent (37.057 ms) : 36750, 37363
.   : milestone, 37057,
appsec (48.589 ms) : 48171, 49006
.   : milestone, 48589,
code_origins (43.647 ms) : 43276, 44017
.   : milestone, 43647,
iast (44.914 ms) : 44526, 45303
.   : milestone, 44914,
profiling (47.477 ms) : 46984, 47971
.   : milestone, 47477,
tracing (42.625 ms) : 42261, 42990
.   : milestone, 42625,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.963 ms [36.662 ms, 37.264 ms]	-
appsec	47.257 ms [46.845 ms, 47.67 ms]	10.294 ms (27.9%)
code_origins	43.553 ms [43.171 ms, 43.935 ms]	6.59 ms (17.8%)
iast	45.321 ms [44.915 ms, 45.728 ms]	8.358 ms (22.6%)
profiling	47.207 ms [46.749 ms, 47.664 ms]	10.244 ms (27.7%)
tracing	43.594 ms [43.226 ms, 43.962 ms]	6.631 ms (17.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.057 ms [36.75 ms, 37.363 ms]	-
appsec	48.589 ms [48.171 ms, 49.006 ms]	11.532 ms (31.1%)
code_origins	43.647 ms [43.276 ms, 44.017 ms]	6.59 ms (17.8%)
iast	44.914 ms [44.526 ms, 45.303 ms]	7.857 ms (21.2%)
profiling	47.477 ms [46.984 ms, 47.971 ms]	10.421 ms (28.1%)
tracing	42.625 ms [42.261 ms, 42.99 ms]	5.569 ms (15.0%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~e996b7c000, baseline=1.55.0-SNAPSHOT~f296927f57
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.33 ms) : 4278, 4382
.   : milestone, 4330,
iast (10.278 ms) : 10102, 10454
.   : milestone, 10278,
iast_FULL (14.393 ms) : 14107, 14679
.   : milestone, 14393,
iast_GLOBAL (10.48 ms) : 10293, 10667
.   : milestone, 10480,
profiling (9.142 ms) : 8988, 9295
.   : milestone, 9142,
tracing (7.857 ms) : 7743, 7972
.   : milestone, 7857,
section candidate
no_agent (4.312 ms) : 4262, 4361
.   : milestone, 4312,
iast (9.75 ms) : 9581, 9919
.   : milestone, 9750,
iast_FULL (14.73 ms) : 14438, 15021
.   : milestone, 14730,
iast_GLOBAL (10.667 ms) : 10461, 10873
.   : milestone, 10667,
profiling (9.178 ms) : 9036, 9321
.   : milestone, 9178,
tracing (8.271 ms) : 8149, 8393
.   : milestone, 8271,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.33 ms [4.278 ms, 4.382 ms]	-
iast	10.278 ms [10.102 ms, 10.454 ms]	5.948 ms (137.4%)
iast_FULL	14.393 ms [14.107 ms, 14.679 ms]	10.063 ms (232.4%)
iast_GLOBAL	10.48 ms [10.293 ms, 10.667 ms]	6.15 ms (142.0%)
profiling	9.142 ms [8.988 ms, 9.295 ms]	4.811 ms (111.1%)
tracing	7.857 ms [7.743 ms, 7.972 ms]	3.527 ms (81.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.312 ms [4.262 ms, 4.361 ms]	-
iast	9.75 ms [9.581 ms, 9.919 ms]	5.438 ms (126.1%)
iast_FULL	14.73 ms [14.438 ms, 15.021 ms]	10.418 ms (241.6%)
iast_GLOBAL	10.667 ms [10.461 ms, 10.873 ms]	6.356 ms (147.4%)
profiling	9.178 ms [9.036 ms, 9.321 ms]	4.867 ms (112.9%)
tracing	8.271 ms [8.149 ms, 8.393 ms]	3.96 ms (91.8%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/fix-trigger-test-env
git_commit_date	1761260114	1761301500
git_commit_sha	`f296927`	`e996b7c`
release_version	1.55.0-SNAPSHOT~f296927f57	1.55.0-SNAPSHOT~e996b7c000

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1761303550	1761303550
ci_job_id	1195811600	1195811600
ci_pipeline_id	80196334	80196334
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-x7yo1q4h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-x7yo1q4h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~e996b7c000, baseline=1.55.0-SNAPSHOT~f296927f57
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.931 s) : 14931000, 14931000
.   : milestone, 14931000,
appsec (14.822 s) : 14822000, 14822000
.   : milestone, 14822000,
iast (18.456 s) : 18456000, 18456000
.   : milestone, 18456000,
iast_GLOBAL (18.222 s) : 18222000, 18222000
.   : milestone, 18222000,
profiling (15.205 s) : 15205000, 15205000
.   : milestone, 15205000,
tracing (15.355 s) : 15355000, 15355000
.   : milestone, 15355000,
section candidate
no_agent (15.491 s) : 15491000, 15491000
.   : milestone, 15491000,
appsec (14.747 s) : 14747000, 14747000
.   : milestone, 14747000,
iast (18.542 s) : 18542000, 18542000
.   : milestone, 18542000,
iast_GLOBAL (17.741 s) : 17741000, 17741000
.   : milestone, 17741000,
profiling (15.282 s) : 15282000, 15282000
.   : milestone, 15282000,
tracing (15.326 s) : 15326000, 15326000
.   : milestone, 15326000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.931 s [14.931 s, 14.931 s]	-
appsec	14.822 s [14.822 s, 14.822 s]	-109.0 ms (-0.7%)
iast	18.456 s [18.456 s, 18.456 s]	3.525 s (23.6%)
iast_GLOBAL	18.222 s [18.222 s, 18.222 s]	3.291 s (22.0%)
profiling	15.205 s [15.205 s, 15.205 s]	274.0 ms (1.8%)
tracing	15.355 s [15.355 s, 15.355 s]	424.0 ms (2.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.491 s [15.491 s, 15.491 s]	-
appsec	14.747 s [14.747 s, 14.747 s]	-744.0 ms (-4.8%)
iast	18.542 s [18.542 s, 18.542 s]	3.051 s (19.7%)
iast_GLOBAL	17.741 s [17.741 s, 17.741 s]	2.25 s (14.5%)
profiling	15.282 s [15.282 s, 15.282 s]	-209.0 ms (-1.3%)
tracing	15.326 s [15.326 s, 15.326 s]	-165.0 ms (-1.1%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~e996b7c000, baseline=1.55.0-SNAPSHOT~f296927f57
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (3.74 ms) : 3521, 3959
.   : milestone, 3740,
iast (2.218 ms) : 2154, 2281
.   : milestone, 2218,
iast_GLOBAL (2.261 ms) : 2197, 2324
.   : milestone, 2261,
profiling (2.053 ms) : 2002, 2104
.   : milestone, 2053,
tracing (2.025 ms) : 1976, 2075
.   : milestone, 2025,
section candidate
no_agent (1.48 ms) : 1468, 1491
.   : milestone, 1480,
appsec (3.721 ms) : 3503, 3938
.   : milestone, 3721,
iast (2.203 ms) : 2140, 2266
.   : milestone, 2203,
iast_GLOBAL (2.258 ms) : 2194, 2322
.   : milestone, 2258,
profiling (2.078 ms) : 2025, 2131
.   : milestone, 2078,
tracing (2.032 ms) : 1983, 2081
.   : milestone, 2032,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.48 ms [1.469 ms, 1.492 ms]	-
appsec	3.74 ms [3.521 ms, 3.959 ms]	2.259 ms (152.6%)
iast	2.218 ms [2.154 ms, 2.281 ms]	737.131 µs (49.8%)
iast_GLOBAL	2.261 ms [2.197 ms, 2.324 ms]	780.327 µs (52.7%)
profiling	2.053 ms [2.002 ms, 2.104 ms]	572.43 µs (38.7%)
tracing	2.025 ms [1.976 ms, 2.075 ms]	544.706 µs (36.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.48 ms [1.468 ms, 1.491 ms]	-
appsec	3.721 ms [3.503 ms, 3.938 ms]	2.241 ms (151.4%)
iast	2.203 ms [2.14 ms, 2.266 ms]	723.058 µs (48.9%)
iast_GLOBAL	2.258 ms [2.194 ms, 2.322 ms]	778.22 µs (52.6%)
profiling	2.078 ms [2.025 ms, 2.131 ms]	598.172 µs (40.4%)
tracing	2.032 ms [1.983 ms, 2.081 ms]	552.106 µs (37.3%)

cit-pr-commenter · 2025-10-21T11:50:40Z

Test Environment - sbt-scalatest

Job Status: success

Scenario	Overhead (%)
agent	55.47
agentEvpProxy	54.55

cit-pr-commenter · 2025-10-21T11:54:05Z

Test Environment - nebula-release-plugin

Job Status: success

Scenario	Overhead (%)
agent	37.24
agentless	37.30
agentlessCodeCoverage	44.88
agentlessLineCoverage	74.38

cit-pr-commenter · 2025-10-21T11:55:22Z

Test Environment - pass4s

Job Status: success

Scenario	Overhead (%)
agent	6.99
agentless	14.46
agentlessCodeCoverage	15.45

cit-pr-commenter · 2025-10-21T11:55:27Z

Test Environment - netflix-zuul

Job Status: success

Scenario	Overhead (%)
agent	91.77
agentless	84.15
agentlessCodeCoverage	100.83
agentlessLineCoverage	113.47

cit-pr-commenter · 2025-10-21T11:56:14Z

Test Environment - reactive-streams-jvm

Job Status: success

Scenario	Overhead (%)
agent	22.75
agentless	19.17
agentlessCodeCoverage	20.38
agentlessLineCoverage	31.20

cit-pr-commenter · 2025-10-21T12:03:12Z

Test Environment - sonar-kotlin

Job Status: success

Scenario	Overhead (%)
agent	13.42
agentless	12.43
agentlessCodeCoverage	14.96
agentlessLineCoverage	19.25

cit-pr-commenter · 2025-10-21T12:04:23Z

Test Environment - jolokia

Job Status: success

Scenario	Overhead (%)
agent	91.13
agentless	87.28
agentlessCodeCoverage	97.32
agentlessLineCoverage	98.62

cit-pr-commenter · 2025-10-21T12:10:39Z

Test Environment - okhttp

Job Status: success

Scenario	Overhead (%)
agent	18.16
agentless	21.16
agentlessCodeCoverage	19.59
agentlessLineCoverage	36.17

cit-pr-commenter · 2025-10-21T12:17:31Z

Test Environment - spring_boot

Job Status: success

Scenario	Overhead (%)
agent	12.52
agentless	6.24
agentlessCodeCoverage	10.46
agentlessLineCoverage	28.95

cit-pr-commenter · 2025-10-21T12:35:00Z

Test Environment - sonar-java

Job Status: success

Scenario	Overhead (%)
agent	16.39
agentless	14.06
agentlessCodeCoverage	82.04
agentlessLineCoverage	150.09

fix: conditional trigger for test env should be conditional

c98aced

daniel-mohedano added the tag: do not merge Do not merge changes label Oct 21, 2025

fix: add info log for more transparency

bc81fb2

daniel-mohedano added the comp: ci visibility Continuous Integration Visibility label Oct 21, 2025

daniel-mohedano added 3 commits October 21, 2025 13:17

fix: try dynamic child pipeline approach

7408d46

fix: make script executable

ebbbad4

fix: generate dummy job when test environment should be skipped

c9b72a8

fix: update logging

5939c61

daniel-mohedano removed the comp: ci visibility Continuous Integration Visibility label Oct 21, 2025

daniel-mohedano added 2 commits October 22, 2025 10:29

fix: add runner tag to dummy job

5ae5767

feat: additional error handling and force testenv failure

a47cae2

daniel-mohedano added the comp: ci visibility Continuous Integration Visibility label Oct 22, 2025

daniel-mohedano added 5 commits October 22, 2025 17:21

fix: typo

6c314c4

fix: revert failing branch ref

374918a

Merge branch 'master' into daniel.mohedano/fix-trigger-test-env

1e897e5

fix: add ci visibility tests include back in

f0e3379

fix: renaming for better context on job objective

f486248

daniel-mohedano removed the comp: ci visibility Continuous Integration Visibility label Oct 24, 2025

test: force failed test run

d883dbc

daniel-mohedano added the comp: ci visibility Continuous Integration Visibility label Oct 24, 2025

test: revert failing test

e996b7c

daniel-mohedano added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling and removed tag: do not merge Do not merge changes labels Oct 24, 2025

daniel-mohedano requested a review from nikita-tkachenko-datadog October 27, 2025 09:03

daniel-mohedano marked this pull request as ready for review October 27, 2025 09:03

daniel-mohedano requested a review from a team as a code owner October 27, 2025 09:03

daniel-mohedano requested review from randomanderson and removed request for a team October 27, 2025 09:03

daniel-mohedano changed the title ~~fix: conditional trigger for test env should be conditional~~ Use dynamic child pipelines for CiVis test environment trigger Oct 27, 2025

nikita-tkachenko-datadog approved these changes Oct 27, 2025

View reviewed changes

daniel-mohedano merged commit 2413c50 into master Oct 28, 2025
549 of 552 checks passed

daniel-mohedano deleted the daniel.mohedano/fix-trigger-test-env branch October 28, 2025 10:15

github-actions bot added this to the 1.55.0 milestone Oct 28, 2025

Use dynamic child pipelines for CiVis test environment trigger #9814

Use dynamic child pipelines for CiVis test environment trigger #9814

Uh oh!

Conversation

daniel-mohedano commented Oct 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

datadog-datadog-prod-us1 bot commented Oct 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Oct 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

cit-pr-commenter bot commented Oct 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - sbt-scalatest

Uh oh!

cit-pr-commenter bot commented Oct 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - nebula-release-plugin

Uh oh!

cit-pr-commenter bot commented Oct 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - pass4s

Uh oh!

cit-pr-commenter bot commented Oct 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - netflix-zuul

Uh oh!

cit-pr-commenter bot commented Oct 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - reactive-streams-jvm

Uh oh!

cit-pr-commenter bot commented Oct 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - sonar-kotlin

Uh oh!

cit-pr-commenter bot commented Oct 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - jolokia

Uh oh!

cit-pr-commenter bot commented Oct 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - okhttp

Uh oh!

cit-pr-commenter bot commented Oct 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - spring_boot

Uh oh!

cit-pr-commenter bot commented Oct 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - sonar-java

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

daniel-mohedano commented Oct 21, 2025 •

edited

Loading

datadog-datadog-prod-us1 bot commented Oct 21, 2025 •

edited

Loading

pr-commenter bot commented Oct 21, 2025 •

edited

Loading

cit-pr-commenter bot commented Oct 21, 2025 •

edited

Loading

cit-pr-commenter bot commented Oct 21, 2025 •

edited

Loading

cit-pr-commenter bot commented Oct 21, 2025 •

edited

Loading

cit-pr-commenter bot commented Oct 21, 2025 •

edited

Loading

cit-pr-commenter bot commented Oct 21, 2025 •

edited

Loading

cit-pr-commenter bot commented Oct 21, 2025 •

edited

Loading

cit-pr-commenter bot commented Oct 21, 2025 •

edited

Loading

cit-pr-commenter bot commented Oct 21, 2025 •

edited

Loading

cit-pr-commenter bot commented Oct 21, 2025 •

edited

Loading

cit-pr-commenter bot commented Oct 21, 2025 •

edited

Loading