Skip to content

[java] Activate span probe expression budgets test (DEBUG-3797) - #8178

Open
jpbempel wants to merge 3 commits into
mainfrom
jpbempel/activate-debug-3797
Open

jpbempel wants to merge 3 commits into
mainfrom
jpbempel/activate-debug-3797

Conversation

@jpbempel

@jpbempel jpbempel commented Oct 26, 2026 •

Copy link
Copy Markdown
Member

Motivation

DEBUG-3797 was fixed in dd-trace-java v1.60.0 by DataDog/dd-trace-java#10529 (rate limit on span decoration probe errors).

Changes

  • Remove the unconditional @bug decorator on Test_Debugger_Probe_Budgets::test_span_probe_expression_budgets.
  • Restrict the bug (DEBUG-3797) manifest entry in manifests/java.yml to component_version: <1.60.0.

Workflow

  1. ⚠️ Create your PR as draft ⚠️
  2. Work on you PR until the CI passes
  3. Mark it as ready for review
    • Tests, manifest, weblog are modified -> you'll need a review from system-tests-reviewers: ask to one of youre co-worker familiar with the tested feature.
    • Framework is modified, or non obvious usage of it -> get a review from system-tests-core (slack)

🚀 Once your PR is reviewed and the CI green, you can merge it!

🛟 #apm-shared-testing 🛟

🤖 Generated with Claude Code

DEBUG-3797 was fixed in dd-trace-java v1.60.0 (DataDog/dd-trace-java#10529,
rate limit on span decoration probe errors). Replace the unconditional bug
decorator with a manifest entry restricted to versions < 1.60.0.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions

github-actions Bot commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor

CODEOWNERS have been resolved as:

manifests/java.yml                                                      @DataDog/system-tests-reviewers
tests/debugger/test_debugger_probe_budgets.py                           @DataDog/debugger
tests/debugger/utils/probes/probe_span_line_budgets_expression.json     @DataDog/debugger

@datadog-datadog-us1-prod

datadog-datadog-us1-prod Bot commented Oct 26, 2026 •

Copy link
Copy Markdown

Pipelines  Tests

🎉 All green!

🧪 All tests passed
❄️ No new flaky tests detected

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 01033df | Docs | View more details | Give us feedback!

jpbempel and others added 2 commits October 26, 2026 18:03
Java's per-probe error sampler (AdaptiveSampler, 1/s) starts with a budget
of 17 samples, so up to ~16 error snapshots are emitted in the first second.
Raise the buffer to 20 for Java only; other languages keep the +5 buffer.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Sending 150 separate requests lowered the agent sampling rate for the
weblog, dropping traces of the following span decoration tests. Use a span
decoration line probe in the /debugger/budgets loop body and a single
/debugger/budgets/150 request instead.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@jpbempel
jpbempel marked this pull request as ready for review October 26, 2026 19:55
@jpbempel
jpbempel requested review from a team as code owners October 26, 2026 19:55
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 26, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-26T19:59:31.067954Z 01033df Draft marked ready
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 01033df704

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

# Allow a buffer for timing imprecision.
max_expected = int(self.total_request_time) + 5
# Java's adaptive sampler starts with a budget of 17, allowing an initial burst on top of the 1/s rate.
buffer = 20 if context.library == "java" else 5

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Split out the Java-specific assertion budget

When this shared test is enabled for another tracer, this branch silently changes its assertion tolerance based on the runtime library. The repository's .cursor/rules/pr-review.mdc guideline explicitly prohibits runtime library branching in test logic and requires separate test methods selected through manifests; move the Java adaptive-sampler allowance into a Java-activated test rather than retaining context.library here.

AGENTS.md reference: AGENTS.md:L34-L36

Useful? React with 👍 / 👎.

Comment thread manifests/java.yml
tests/debugger/test_debugger_probe_budgets.py::Test_Debugger_Probe_Budgets::test_span_probe_expression_budgets: bug (DEBUG-3797)
tests/debugger/test_debugger_probe_budgets.py::Test_Debugger_Probe_Budgets::test_span_probe_expression_budgets:
- declaration: bug (DEBUG-3797)
component_version: <1.60.0

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Quote the manifest version constraint

Quote '<1.60.0' here. The manifest syntax rule in .cursor/rules/pr-review.mdc requires values containing < to be quoted, so the newly added declaration does not conform to the repository's required YAML form and validation expectations.

AGENTS.md reference: AGENTS.md:L17-L24

Useful? React with 👍 / 👎.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant