Skip to content

bug: issue-triage workflow false-positives all bug reports due to H2/H3 heading mismatch #603

Description

@minhdqdev

Agent Diagnostic

  • Investigated by reading .github/workflows/issue-triage.yml and .github/ISSUE_TEMPLATE/bug_report.yml side-by-side.
  • Confirmed that GitHub issue form templates always render textarea field labels as ### (H3) headings in the submitted issue body — this is fixed GitHub platform behavior.
  • The workflow regex searches for ## Agent Diagnostic (H2), which never matches a body generated by the form template.
  • Verified no other workflows parse the issue body heading format — only issue-triage.yml is affected.
  • Fix is in issue-triage.yml: change the regex to match ### instead of ##.

Description

Every bug report submitted via the GitHub issue form template is incorrectly flagged with state:triage-needed, even when the reporter has fully filled in the Agent Diagnostic section.

The root cause is a heading-level mismatch:

  • bug_report.yml defines type: textarea with label: Agent Diagnostic. GitHub renders this as ### Agent Diagnostic (H3) in the submitted issue body — this is fixed platform behavior that cannot be overridden from the template.
  • issue-triage.yml checks for the section using /## Agent Diagnostic\s*\n/ (H2). This regex never matches, so hasSubstantiveDiagnostic is always false, and every bug report is flagged.

The result: compliant reporters are told their investigation is missing, undermining trust in the triage gate and creating unnecessary noise for maintainers.

Reproduction Steps

  1. Open a bug report via the GitHub issue template form UI.
  2. Fill in all fields including a substantive Agent Diagnostic.
  3. Submit the issue with a title starting with bug:.
  4. Observe that state:triage-needed is applied and a redirect comment is posted, despite the diagnostic being present.

Environment

  • Affects all bug reports submitted via the issue template form
  • GitHub always renders textarea labels as ### regardless of template content

Logs

Agent diagnostic section missing or placeholder. Flagging.

Logged on every submission, even for fully-filled issues.

Agent-First Checklist

  • I pointed my agent at the repo and had it investigate this issue
  • I loaded relevant skills (e.g., debug-openshell-cluster, debug-inference, openshell-cli)
  • My agent could not resolve this — the diagnostic above explains why

Activity

  1. github-actions commented on Mar 25, 2026

    @github-actions

    This issue appears to have been opened without an agent investigation.

    OpenShell is an agent-first project - please point your coding agent at the repo and have it diagnose this before we triage. Your agent can load skills like debug-openshell-cluster, debug-inference, openshell-cli, and generate-sandbox-policy.

    See CONTRIBUTING.md for the full workflow.

  2. minhdqdev commented on Mar 25, 2026

    @minhdqdev
    ContributorAuthor

    This issue appears to have been opened without an agent investigation.

    OpenShell is an agent-first project - please point your coding agent at the repo and have it diagnose this before we triage. Your agent can load skills like debug-openshell-cluster, debug-inference, openshell-cli, and generate-sandbox-policy.

    See CONTRIBUTING.md for the full workflow.

    That's what I'm talking about.

  3. removed
    state:triage-neededOpened without agent diagnostics and needs triage
    on Oct 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions