Test sarahchen6/improve-startup-stability branch of apm-sdks-benchmarks

[sarahchen6]

What Does This Do

Test changes made in https://github.com/DataDog/apm-sdks-benchmarks/pull/162

Motivation

Additional Notes

Contributor Checklist

• Format the title according to the contribution guidelines
• Assign the type: and (comp: or inst:) labels in addition to any other useful labels
• Avoid using close, fix, or any linking keywords when referencing an issue
  Use solves instead, and assign the PR milestone to the issue
• Update the CODEOWNERS file on source file addition, migration, or deletion
• Update public documentation with any new configuration flags or behaviors
• Add your completed PR to the merge queue by commenting /merge. You can also:
  • Customize the commit message associated with the merge with /merge --commit-message "..."
  • Remove your PR from the merge queue with /merge -c
  • Skip all merge queue checks with /merge -f --reason "reason"; please use this judiciously, as some checks do not run at the PR-level
  • Get more information in this doc

Jira ticket: [PROJ-IDENT]

[datadog-datadog-prod-us1-2]

✨ Fix all issues with BitsAI

⚠️ Warnings

🚦 3 Pipeline jobs failed

DataDog/apm-reliability/dd-trace-java | muzzle: [4/8]     

🔄 Retry job. This looks flaky and may succeed on retry.

Repository access failed for org.seleniumhq.selenium:selenium-java:4.37.0 due to a 503 Service Unavailable error.

Run system tests | main / End-to-end #3 / akka-http 3     

🔄 Retry job. This looks flaky and may succeed on retry.

Error response from daemon: Get "https://registry-1.docker.io/v2/": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) after 4 attempts.

Run system tests | main / End-to-end #5 / resteasy-netty3 5     

🔄 Retry job. This looks flaky and may succeed on retry.

Error response from daemon: context deadline exceeded while trying to reach Docker registry after multiple attempts.

Useful? React with 👍 / 👎

_{This comment will be updated automatically if new data arrives.
🔗 Commit SHA: fd518c4 | Docs | Datadog PR Page | Give us feedback!}

[dd-octo-sts]

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite	Status
Startup	🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results

Scenario	Candidate	master	Δ (95% CI of mean)
startup:insecure-bank:iast:Agent	13.71 s	13.96 s	[+nan%; +nan%] (no difference)
startup:insecure-bank:tracing:Agent	12.60 s	12.82 s	[+nan%; +nan%] (no difference)
startup:petclinic:appsec:Agent	16.24 s	16.24 s	[+nan%; +nan%] (no difference)
startup:petclinic:iast:Agent	16.17 s	16.10 s	[+nan%; +nan%] (no difference)
startup:petclinic:profiling:Agent	16.20 s	15.72 s	[+nan%; +nan%] (no difference)
startup:petclinic:tracing:Agent	15.96 s	15.65 s	[+nan%; +nan%] (no difference)

Commit: fd518c44 · CI Pipeline · Benchmarking Platform UI

---

Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.