Skip to content

Document IT discovery and reliability guidelines - #19058

Merged
JackieTien97 merged 1 commit into
masterfrom
ty/it-authoring-guidelines
Oct 30, 2026
Merged

JackieTien97 merged 1 commit into
masterfrom
ty/it-authoring-guidelines

Conversation

@JackieTien97

Copy link
Copy Markdown
Contributor

Description

PR #19052 exposed integration tests that CI silently skipped because of class names, missing categories, and shard selection that overlooked inherited categories. Update integration-test/AGENTS.md with discoverable naming, category/profile mapping, runner inheritance, the selection-check command, and verification of actual Failsafe execution and shard coverage.

Also document reusable lessons from the newly enabled tests: wait for asynchronous cleanup and derive unavoidable delays from effective server configuration, preserve regression coverage when updating expectations or quarantining a product defect, and account for process-exit portability and single-/multi-DataNode behavior.

Validation

  • git diff --check passed.

  • python3 .github/scripts/check-it-selection.py passed: 825 test classes checked; the three shard lists cover each candidate exactly once.

  • Documentation-only change; no Maven build or integration-test execution was needed.

  • Self-reviewed.

  • Updated integration-test authoring documentation.

@sonarqubecloud

Copy link
Copy Markdown

Quality Gate Failed Quality Gate failed

Failed conditions
E Reliability Rating on New Code (required ≥ A)
C Security Rating on New Code (required ≥ A)

See analysis details on SonarQube Cloud

Catch issues before they fail your Quality Gate with our IDE extension SonarQube for IDE

@JackieTien97
JackieTien97 merged commit 56aca60 into master Oct 30, 2026
40 of 41 checks passed
@JackieTien97
JackieTien97 deleted the ty/it-authoring-guidelines branch October 30, 2026 04:17
@codecov

codecov Bot commented Oct 30, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 48.06%. Comparing base (45a78ca) to head (e0e4627).
⚠️ Report is 3 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff            @@
##             master   #19058   +/-   ##
=========================================
  Coverage     48.06%   48.06%           
  Complexity      604      604           
=========================================
  Files          5572     5572           
  Lines        410019   410019           
  Branches      54059    54059           
=========================================
+ Hits         197058   197076   +18     
+ Misses       212961   212943   -18     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant