Skip to content

Update system-tests to 5aee0ed598fd984344cf0da0048b27bdb2eb4da1 #8537

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Mar 11, 2025
Merged

Update system-tests to 5aee0ed598fd984344cf0da0048b27bdb2eb4da1 #8537

merged 1 commit into from
Mar 11, 2025

Conversation

mhlidd
Copy link
Contributor

@mhlidd mhlidd commented Mar 11, 2025

What Does This Do

Help fix CI system-tests failures that were recently fixed.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@pr-commenter
Copy link

pr-commenter bot commented Mar 11, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/update_system_tests_hash
git_commit_date 1741707364 1741714757
git_commit_sha f8c6b49 9577564
release_version 1.48.0-SNAPSHOT~f8c6b49f18 1.48.0-SNAPSHOT~9577564f7f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741717270 1741717270
ci_job_id 842955516 842955516
ci_pipeline_id 58465015 58465015
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-2wkmbgws-project-304-concurrent-0-2t1i830n 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-2wkmbgws-project-304-concurrent-0-2t1i830n 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 3 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1044833
Total [baseline] (8.711 s) : 0, 8710651
Agent [candidate] (1.043 s) : 0, 1042606
Total [candidate] (8.685 s) : 0, 8685421
section iast
Agent [baseline] (1.172 s) : 0, 1172072
Total [baseline] (9.25 s) : 0, 9249589
Agent [candidate] (1.188 s) : 0, 1187707
Total [candidate] (9.275 s) : 0, 9274916
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.173 s) : 0, 1173493
Total [baseline] (9.228 s) : 0, 9227541
Agent [candidate] (1.175 s) : 0, 1174795
Total [candidate] (9.239 s) : 0, 9238916
section iast_TELEMETRY_OFF
Agent [baseline] (1.179 s) : 0, 1178819
Total [baseline] (9.269 s) : 0, 9268518
Agent [candidate] (1.169 s) : 0, 1168912
Total [candidate] (9.272 s) : 0, 9271895
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent iast 1.172 s 127.24 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.173 s 128.66 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.179 s 133.987 ms (12.8%)
Total tracing 8.711 s -
Total iast 9.25 s 538.938 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.228 s 516.89 ms (5.9%)
Total iast_TELEMETRY_OFF 9.269 s 557.867 ms (6.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.043 s -
Agent iast 1.188 s 145.101 ms (13.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.175 s 132.188 ms (12.7%)
Agent iast_TELEMETRY_OFF 1.169 s 126.306 ms (12.1%)
Total tracing 8.685 s -
Total iast 9.275 s 589.495 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.239 s 553.495 ms (6.4%)
Total iast_TELEMETRY_OFF 9.272 s 586.474 ms (6.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (720.124 ms) : 0, 720124
BytebuddyAgent [candidate] (718.841 ms) : 0, 718841
GlobalTracer [baseline] (239.963 ms) : 0, 239963
GlobalTracer [candidate] (239.546 ms) : 0, 239546
AppSec [baseline] (55.268 ms) : 0, 55268
AppSec [candidate] (55.055 ms) : 0, 55055
Remote Config [baseline] (686.077 µs) : 0, 686
Remote Config [candidate] (682.442 µs) : 0, 682
Telemetry [baseline] (13.842 ms) : 0, 13842
Telemetry [candidate] (13.494 ms) : 0, 13494
section iast
BytebuddyAgent [baseline] (837.852 ms) : 0, 837852
BytebuddyAgent [candidate] (850.532 ms) : 0, 850532
GlobalTracer [baseline] (230.535 ms) : 0, 230535
GlobalTracer [candidate] (232.686 ms) : 0, 232686
IAST [baseline] (22.788 ms) : 0, 22788
IAST [candidate] (23.23 ms) : 0, 23230
AppSec [baseline] (56.676 ms) : 0, 56676
AppSec [candidate] (56.736 ms) : 0, 56736
Remote Config [baseline] (617.601 µs) : 0, 618
Remote Config [candidate] (622.703 µs) : 0, 623
Telemetry [baseline] (8.677 ms) : 0, 8677
Telemetry [candidate] (8.78 ms) : 0, 8780
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (839.054 ms) : 0, 839054
BytebuddyAgent [candidate] (839.294 ms) : 0, 839294
GlobalTracer [baseline] (230.465 ms) : 0, 230465
GlobalTracer [candidate] (231.317 ms) : 0, 231317
IAST [baseline] (23.03 ms) : 0, 23030
IAST [candidate] (22.845 ms) : 0, 22845
AppSec [baseline] (56.732 ms) : 0, 56732
AppSec [candidate] (57.098 ms) : 0, 57098
Remote Config [baseline] (605.193 µs) : 0, 605
Remote Config [candidate] (593.47 µs) : 0, 593
Telemetry [baseline] (8.697 ms) : 0, 8697
Telemetry [candidate] (8.711 ms) : 0, 8711
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (841.171 ms) : 0, 841171
BytebuddyAgent [candidate] (835.022 ms) : 0, 835022
GlobalTracer [baseline] (232.413 ms) : 0, 232413
GlobalTracer [candidate] (230.389 ms) : 0, 230389
IAST [baseline] (22.913 ms) : 0, 22913
IAST [candidate] (22.402 ms) : 0, 22402
AppSec [baseline] (57.802 ms) : 0, 57802
AppSec [candidate] (56.939 ms) : 0, 56939
Remote Config [baseline] (629.875 µs) : 0, 630
Remote Config [candidate] (602.936 µs) : 0, 603
Telemetry [baseline] (8.879 ms) : 0, 8879
Telemetry [candidate] (8.63 ms) : 0, 8630
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.04 s) : 0, 1039536
Total [baseline] (10.468 s) : 0, 10468350
Agent [candidate] (1.046 s) : 0, 1045703
Total [candidate] (10.574 s) : 0, 10573938
section appsec
Agent [baseline] (1.191 s) : 0, 1190716
Total [baseline] (10.766 s) : 0, 10765854
Agent [candidate] (1.183 s) : 0, 1182949
Total [candidate] (10.765 s) : 0, 10764577
section iast
Agent [baseline] (1.182 s) : 0, 1181701
Total [baseline] (11.144 s) : 0, 11143815
Agent [candidate] (1.171 s) : 0, 1171324
Total [candidate] (10.995 s) : 0, 10995272
section profiling
Agent [baseline] (1.269 s) : 0, 1268661
Total [baseline] (10.899 s) : 0, 10899446
Agent [candidate] (1.269 s) : 0, 1269204
Total [candidate] (10.854 s) : 0, 10853624
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent appsec 1.191 s 151.18 ms (14.5%)
Agent iast 1.182 s 142.166 ms (13.7%)
Agent profiling 1.269 s 229.125 ms (22.0%)
Total tracing 10.468 s -
Total appsec 10.766 s 297.504 ms (2.8%)
Total iast 11.144 s 675.465 ms (6.5%)
Total profiling 10.899 s 431.096 ms (4.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent appsec 1.183 s 137.246 ms (13.1%)
Agent iast 1.171 s 125.621 ms (12.0%)
Agent profiling 1.269 s 223.501 ms (21.4%)
Total tracing 10.574 s -
Total appsec 10.765 s 190.639 ms (1.8%)
Total iast 10.995 s 421.334 ms (4.0%)
Total profiling 10.854 s 279.686 ms (2.6%) 
gantt
    title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.587 ms) : 0, 717587
BytebuddyAgent [candidate] (719.755 ms) : 0, 719755
GlobalTracer [baseline] (239.526 ms) : 0, 239526
GlobalTracer [candidate] (240.514 ms) : 0, 240514
AppSec [baseline] (55.405 ms) : 0, 55405
AppSec [candidate] (55.539 ms) : 0, 55539
Remote Config [baseline] (682.392 µs) : 0, 682
Remote Config [candidate] (699.95 µs) : 0, 700
Telemetry [baseline] (11.477 ms) : 0, 11477
Telemetry [candidate] (14.288 ms) : 0, 14288
section appsec
BytebuddyAgent [baseline] (741.731 ms) : 0, 741731
BytebuddyAgent [candidate] (735.954 ms) : 0, 735954
GlobalTracer [baseline] (237.158 ms) : 0, 237158
GlobalTracer [candidate] (236.088 ms) : 0, 236088
IAST [baseline] (21.774 ms) : 0, 21774
IAST [candidate] (21.56 ms) : 0, 21560
AppSec [baseline] (175.985 ms) : 0, 175985
AppSec [candidate] (175.976 ms) : 0, 175976
Remote Config [baseline] (661.795 µs) : 0, 662
Remote Config [candidate] (655.523 µs) : 0, 656
Telemetry [baseline] (9.314 ms) : 0, 9314
Telemetry [candidate] (8.631 ms) : 0, 8631
section iast
BytebuddyAgent [baseline] (845.197 ms) : 0, 845197
BytebuddyAgent [candidate] (837.578 ms) : 0, 837578
GlobalTracer [baseline] (232.277 ms) : 0, 232277
GlobalTracer [candidate] (230.718 ms) : 0, 230718
IAST [baseline] (23.011 ms) : 0, 23011
IAST [candidate] (22.547 ms) : 0, 22547
AppSec [baseline] (56.861 ms) : 0, 56861
AppSec [candidate] (56.377 ms) : 0, 56377
Remote Config [baseline] (614.754 µs) : 0, 615
Remote Config [candidate] (599.914 µs) : 0, 600
Telemetry [baseline] (8.816 ms) : 0, 8816
Telemetry [candidate] (8.649 ms) : 0, 8649
section profiling
BytebuddyAgent [baseline] (715.064 ms) : 0, 715064
BytebuddyAgent [candidate] (715.253 ms) : 0, 715253
GlobalTracer [baseline] (350.634 ms) : 0, 350634
GlobalTracer [candidate] (352.441 ms) : 0, 352441
AppSec [baseline] (55.544 ms) : 0, 55544
AppSec [candidate] (54.373 ms) : 0, 54373
Remote Config [baseline] (681.747 µs) : 0, 682
Remote Config [candidate] (678.369 µs) : 0, 678
Telemetry [baseline] (9.012 ms) : 0, 9012
Telemetry [candidate] (9.066 ms) : 0, 9066
ProfilingAgent [baseline] (97.06 ms) : 0, 97060
ProfilingAgent [candidate] (96.733 ms) : 0, 96733
Profiling [baseline] (97.084 ms) : 0, 97084
Profiling [candidate] (96.759 ms) : 0, 96759
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-11T17:51:29 2025-03-11T17:59:15
git_branch master mhlidd/update_system_tests_hash
git_commit_date 1741707364 1741714757
git_commit_sha f8c6b49 9577564
release_version 1.48.0-SNAPSHOT~f8c6b49f18 1.48.0-SNAPSHOT~9577564f7f
start_time 2025-03-11T17:51:15 2025-03-11T17:59:01
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741716353 1741716353
ci_job_id 842955517 842955517
ci_pipeline_id 58465015 58465015
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-2wkmbgws-project-304-concurrent-1-cr6e89qm 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-2wkmbgws-project-304-concurrent-1-cr6e89qm 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.358 ms) : 1339, 1377
.   : milestone, 1358,
appsec (1.742 ms) : 1718, 1766
.   : milestone, 1742,
appsec_no_iast (1.738 ms) : 1712, 1763
.   : milestone, 1738,
code_origins (1.696 ms) : 1669, 1723
.   : milestone, 1696,
iast (1.518 ms) : 1494, 1542
.   : milestone, 1518,
profiling (1.537 ms) : 1512, 1562
.   : milestone, 1537,
tracing (1.514 ms) : 1489, 1538
.   : milestone, 1514,
section candidate
no_agent (1.354 ms) : 1334, 1375
.   : milestone, 1354,
appsec (1.746 ms) : 1723, 1770
.   : milestone, 1746,
appsec_no_iast (1.775 ms) : 1750, 1799
.   : milestone, 1775,
code_origins (1.676 ms) : 1648, 1703
.   : milestone, 1676,
iast (1.52 ms) : 1495, 1545
.   : milestone, 1520,
profiling (1.531 ms) : 1508, 1554
.   : milestone, 1531,
tracing (1.484 ms) : 1459, 1510
.   : milestone, 1484,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.358 ms [1.339 ms, 1.377 ms] -
appsec 1.742 ms [1.718 ms, 1.766 ms] 383.798 µs (28.3%)
appsec_no_iast 1.738 ms [1.712 ms, 1.763 ms] 379.235 µs (27.9%)
code_origins 1.696 ms [1.669 ms, 1.723 ms] 337.721 µs (24.9%)
iast 1.518 ms [1.494 ms, 1.542 ms] 159.947 µs (11.8%)
profiling 1.537 ms [1.512 ms, 1.562 ms] 178.754 µs (13.2%)
tracing 1.514 ms [1.489 ms, 1.538 ms] 155.485 µs (11.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.354 ms [1.334 ms, 1.375 ms] -
appsec 1.746 ms [1.723 ms, 1.77 ms] 392.11 µs (29.0%)
appsec_no_iast 1.775 ms [1.75 ms, 1.799 ms] 420.433 µs (31.0%)
code_origins 1.676 ms [1.648 ms, 1.703 ms] 321.52 µs (23.7%)
iast 1.52 ms [1.495 ms, 1.545 ms] 165.7 µs (12.2%)
profiling 1.531 ms [1.508 ms, 1.554 ms] 177.003 µs (13.1%)
tracing 1.484 ms [1.459 ms, 1.51 ms] 130.274 µs (9.6%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18
    dateFormat X
    axisFormat %s
section baseline
no_agent (394.825 µs) : 375, 415
.   : milestone, 395,
iast (513.516 µs) : 492, 535
.   : milestone, 514,
iast_FULL (734.871 µs) : 712, 757
.   : milestone, 735,
iast_GLOBAL (563.189 µs) : 541, 585
.   : milestone, 563,
iast_HARDCODED_SECRET_DISABLED (517.232 µs) : 496, 539
.   : milestone, 517,
iast_INACTIVE (465.488 µs) : 444, 487
.   : milestone, 465,
iast_TELEMETRY_OFF (503.309 µs) : 481, 525
.   : milestone, 503,
tracing (467.033 µs) : 445, 489
.   : milestone, 467,
section candidate
no_agent (389.532 µs) : 370, 409
.   : milestone, 390,
iast (512.121 µs) : 490, 534
.   : milestone, 512,
iast_FULL (729.336 µs) : 707, 751
.   : milestone, 729,
iast_GLOBAL (568.028 µs) : 545, 591
.   : milestone, 568,
iast_HARDCODED_SECRET_DISABLED (518.012 µs) : 496, 540
.   : milestone, 518,
iast_INACTIVE (469.555 µs) : 447, 492
.   : milestone, 470,
iast_TELEMETRY_OFF (511.854 µs) : 489, 535
.   : milestone, 512,
tracing (466.229 µs) : 444, 488
.   : milestone, 466,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 394.825 µs [374.82 µs, 414.831 µs] -
iast 513.516 µs [491.576 µs, 535.457 µs] 118.691 µs (30.1%)
iast_FULL 734.871 µs [712.465 µs, 757.276 µs] 340.045 µs (86.1%)
iast_GLOBAL 563.189 µs [541.342 µs, 585.035 µs] 168.363 µs (42.6%)
iast_HARDCODED_SECRET_DISABLED 517.232 µs [495.717 µs, 538.748 µs] 122.407 µs (31.0%)
iast_INACTIVE 465.488 µs [444.271 µs, 486.704 µs] 70.662 µs (17.9%)
iast_TELEMETRY_OFF 503.309 µs [481.397 µs, 525.221 µs] 108.484 µs (27.5%)
tracing 467.033 µs [445.138 µs, 488.927 µs] 72.207 µs (18.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 389.532 µs [369.817 µs, 409.247 µs] -
iast 512.121 µs [490.352 µs, 533.889 µs] 122.589 µs (31.5%)
iast_FULL 729.336 µs [707.389 µs, 751.283 µs] 339.804 µs (87.2%)
iast_GLOBAL 568.028 µs [545.12 µs, 590.935 µs] 178.496 µs (45.8%)
iast_HARDCODED_SECRET_DISABLED 518.012 µs [496.04 µs, 539.985 µs] 128.481 µs (33.0%)
iast_INACTIVE 469.555 µs [446.721 µs, 492.389 µs] 80.023 µs (20.5%)
iast_TELEMETRY_OFF 511.854 µs [489.193 µs, 534.516 µs] 122.323 µs (31.4%)
tracing 466.229 µs [444.32 µs, 488.138 µs] 76.697 µs (19.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/update_system_tests_hash
git_commit_date 1741707364 1741714757
git_commit_sha f8c6b49 9577564
release_version 1.48.0-SNAPSHOT~f8c6b49f18 1.48.0-SNAPSHOT~9577564f7f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1741716885 1741716885
ci_job_id 842955518 842955518
ci_pipeline_id 58465015 58465015
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-2wkmbgws-project-304-concurrent-2-psmz22n4 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-2wkmbgws-project-304-concurrent-2-psmz22n4 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.57 s) : 15570000, 15570000
.   : milestone, 15570000,
appsec (15.017 s) : 15017000, 15017000
.   : milestone, 15017000,
iast (19.091 s) : 19091000, 19091000
.   : milestone, 19091000,
iast_GLOBAL (17.626 s) : 17626000, 17626000
.   : milestone, 17626000,
profiling (15.173 s) : 15173000, 15173000
.   : milestone, 15173000,
tracing (15.082 s) : 15082000, 15082000
.   : milestone, 15082000,
section candidate
no_agent (15.209 s) : 15209000, 15209000
.   : milestone, 15209000,
appsec (14.977 s) : 14977000, 14977000
.   : milestone, 14977000,
iast (18.475 s) : 18475000, 18475000
.   : milestone, 18475000,
iast_GLOBAL (17.68 s) : 17680000, 17680000
.   : milestone, 17680000,
profiling (15.192 s) : 15192000, 15192000
.   : milestone, 15192000,
tracing (14.908 s) : 14908000, 14908000
.   : milestone, 14908000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.57 s [15.57 s, 15.57 s] -
appsec 15.017 s [15.017 s, 15.017 s] -553.0 ms (-3.6%)
iast 19.091 s [19.091 s, 19.091 s] 3.521 s (22.6%)
iast_GLOBAL 17.626 s [17.626 s, 17.626 s] 2.056 s (13.2%)
profiling 15.173 s [15.173 s, 15.173 s] -397.0 ms (-2.5%)
tracing 15.082 s [15.082 s, 15.082 s] -488.0 ms (-3.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.209 s [15.209 s, 15.209 s] -
appsec 14.977 s [14.977 s, 14.977 s] -232.0 ms (-1.5%)
iast 18.475 s [18.475 s, 18.475 s] 3.266 s (21.5%)
iast_GLOBAL 17.68 s [17.68 s, 17.68 s] 2.471 s (16.2%)
profiling 15.192 s [15.192 s, 15.192 s] -17.0 ms (-0.1%)
tracing 14.908 s [14.908 s, 14.908 s] -301.0 ms (-2.0%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.341 ms) : 2296, 2387
.   : milestone, 2341,
iast (2.124 ms) : 2067, 2181
.   : milestone, 2124,
iast_GLOBAL (2.162 ms) : 2105, 2219
.   : milestone, 2162,
profiling (1.989 ms) : 1943, 2035
.   : milestone, 1989,
tracing (1.959 ms) : 1916, 2003
.   : milestone, 1959,
section candidate
no_agent (1.47 ms) : 1458, 1481
.   : milestone, 1470,
appsec (2.351 ms) : 2306, 2397
.   : milestone, 2351,
iast (2.126 ms) : 2069, 2183
.   : milestone, 2126,
iast_GLOBAL (2.168 ms) : 2111, 2226
.   : milestone, 2168,
profiling (1.976 ms) : 1930, 2021
.   : milestone, 1976,
tracing (1.954 ms) : 1910, 1998
.   : milestone, 1954,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 2.341 ms [2.296 ms, 2.387 ms] 870.417 µs (59.2%)
iast 2.124 ms [2.067 ms, 2.181 ms] 653.259 µs (44.4%)
iast_GLOBAL 2.162 ms [2.105 ms, 2.219 ms] 690.959 µs (47.0%)
profiling 1.989 ms [1.943 ms, 2.035 ms] 518.159 µs (35.2%)
tracing 1.959 ms [1.916 ms, 2.003 ms] 488.524 µs (33.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.458 ms, 1.481 ms] -
appsec 2.351 ms [2.306 ms, 2.397 ms] 881.53 µs (60.0%)
iast 2.126 ms [2.069 ms, 2.183 ms] 655.816 µs (44.6%)
iast_GLOBAL 2.168 ms [2.111 ms, 2.226 ms] 698.383 µs (47.5%)
profiling 1.976 ms [1.93 ms, 2.021 ms] 505.743 µs (34.4%)
tracing 1.954 ms [1.91 ms, 1.998 ms] 483.811 µs (32.9%)

@mhlidd mhlidd marked this pull request as ready for review March 11, 2025 19:05
@mhlidd mhlidd requested a review from a team as a code owner March 11, 2025 19:05
@github-actions GitHub Actions
Copy link
Contributor

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@mhlidd mhlidd added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Mar 11, 2025
@mhlidd mhlidd merged commit 3c27cfc into master Mar 11, 2025
223 of 224 checks passed
@mhlidd mhlidd deleted the mhlidd/update_system_tests_hash branch March 11, 2025 19:07
@github-actions github-actions bot added this to the 1.48.0 milestone Mar 11, 2025
mtoffl01 pushed a commit that referenced this pull request Mar 24, 2025
@mhlidd @mtoffl01
Update system-tests to 5aee0ed598fd984344cf0da0048b27bdb2eb4da1 (#8537)
9a4458a
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nayeem-kamal nayeem-kamal nayeem-kamal approved these changes

@manuel-alvarez-alvarez manuel-alvarez-alvarez Awaiting requested review from manuel-alvarez-alvarez manuel-alvarez-alvarez is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.48.0
Development

Successfully merging this pull request may close these issues.
2 participants
@mhlidd @nayeem-kamal