Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 17 additions & 0 deletions .agents/skills/watch-github-actions/SKILL.md
Original file line number Diff line number Diff line change
Expand Up @@ -131,6 +131,23 @@ gh run list --json databaseId,status,headBranch,url --jq '.[] | {id: .databaseId

`Release Dev` finishes its active run and replaces pending runs when new commits arrive. Other callers retain E2E cancellation. Inspect job annotations for cancellation reasons.

## GKE runner trial

Branch Checks Linux amd64 jobs from ai-openshell/openshell branches run on the
`openshell-ci-amd64` ARC scale set during the GKE trial. Fork, ARM, and macOS jobs
keep their hosted runners. Confirm the runner name in the job details before
attributing a result to GKE. For a job-container or PostgreSQL startup failure,
check the runner pod's Docker sidecar first. A missing `gh` executable or
Cachix's `$USER must be set` error indicates incomplete runner bootstrap.
For a preloaded image, `setup-nix` verifies its global Cachix substituter and
skips adding it again. A cache-configuration permission failure indicates the
image/setup contract is out of sync. Rust jobs report shared memcached
sccache statistics; distinguish backend connectivity errors from compiler/test
failures. The x86 GKE lint/test jobs also trial separate full Cargo artifact
caches. Confirm the restored key and cache size in setup-rust, and include the
post-job save time when comparing cold and warm runs. A hit does not guarantee
Cargo will reuse every artifact. See `CI.md` for the trial scope and cache setup.

## View Job Logs

For Branch Checks `Reviewer Roster` failures, the log lists non-collaborators in
Expand Down
1 change: 1 addition & 0 deletions .github/actionlint.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,7 @@

self-hosted-runner:
labels:
- openshell-ci-amd64
- ubuntu-26.04
- windows-arm64

Expand Down
8 changes: 8 additions & 0 deletions .github/actions/setup-nix/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,9 +32,17 @@ runs:
extra-conf: |
http2 = false

- name: Verify GKE image cache configuration
if: ${{ startsWith(runner.name, 'openshell-ci-amd64-') }}
shell: bash
run: |
nix config show --json | jq -e '.substituters.value | index("https://openshell.cachix.org") != null' > /dev/null

- uses: cachix/cachix-action@5f2d7c5294214f71b873db4b969586b980625e71 # v17
with:
name: openshell
# The image configures the substituter globally before dropping to runner.
skipAddingSubstituter: ${{ startsWith(runner.name, 'openshell-ci-amd64-') }}
authToken: ${{ inputs.cachix-auth-token }}
skipPush: ${{ inputs.cachix-auth-token == '' }}

Expand Down
18 changes: 18 additions & 0 deletions .github/actions/setup-rust/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,10 @@ inputs:
description: Whether this job writes the Rust target cache
required: false
default: "false"
cache-workspace-crates:
description: Retain workspace build artifacts as well as dependencies
required: false
default: "false"

outputs:
cache-hit:
Expand All @@ -21,6 +25,19 @@ outputs:
runs:
using: composite
steps:
- name: Configure shared sccache on GKE runners
if: ${{ runner.environment == 'self-hosted' && startsWith(runner.name, 'openshell-ci-amd64-') }}
shell: nix develop -c bash -euo pipefail {0}
run: |
mise install --locked github:mozilla/sccache
sccache_bin=$(mise which sccache)
dirname "$sccache_bin" >> "$GITHUB_PATH"
{
echo "RUSTC_WRAPPER=$sccache_bin"
echo "SCCACHE_MEMCACHED_ENDPOINT=tcp://memcached.sccache:11211"
echo "SCCACHE_BASEDIRS=$GITHUB_WORKSPACE"
} >> "$GITHUB_ENV"

- name: Hash Nix development shell
id: dev-shell
shell: bash
Expand All @@ -36,4 +53,5 @@ runs:
save-if: ${{ inputs.save-cache }}
cache-on-failure: ${{ inputs.save-cache }}
cache-bin: "false"
cache-workspace-crates: ${{ inputs.cache-workspace-crates }}
cmd-format: nix develop -c {0}
84 changes: 59 additions & 25 deletions .github/workflows/branch-checks.yml
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ concurrency:
jobs:
reviewer-roster:
name: Reviewer Roster
runs-on: ubuntu-latest
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-latest' }}
timeout-minutes: 5
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
Expand Down Expand Up @@ -59,7 +59,7 @@ jobs:
${{ !cancelled() && github.event_name == 'pull_request'
&& needs.compatibility-review.outputs.has_findings == 'true'
&& needs.compatibility-review.outputs.report_artifact != '' }}
runs-on: ubuntu-latest
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-latest' }}
timeout-minutes: 5
continue-on-error: true
permissions:
Expand Down Expand Up @@ -98,7 +98,7 @@ jobs:

protobuf-compatibility:
name: Protobuf Compatibility
runs-on: ubuntu-24.04
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-24.04' }}
timeout-minutes: 15
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
Expand All @@ -116,7 +116,7 @@ jobs:

monitoring-changes:
name: Detect monitoring mixin changes
runs-on: ubuntu-latest
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-latest' }}
timeout-minutes: 5
outputs:
changed: ${{ steps.changes.outputs.changed }}
Expand Down Expand Up @@ -153,7 +153,7 @@ jobs:
name: Monitoring Mixin
needs: monitoring-changes
if: needs.monitoring-changes.outputs.changed == 'true'
runs-on: ubuntu-24.04
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-24.04' }}
timeout-minutes: 15
container:
image: ghcr.io/ai-openshell/openshell/ci:82e753ba3ffdfb40c118e7cb416ced7f350381d5@sha256:d816f3b4b2de675928e2ecfd26ec6b937be35fe9986542c87d440bc3de5a29de
Expand All @@ -174,7 +174,7 @@ jobs:

mise-lockfile:
name: mise Lockfile
runs-on: ubuntu-24.04
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-24.04' }}
timeout-minutes: 30
container:
image: ghcr.io/ai-openshell/openshell/ci:82e753ba3ffdfb40c118e7cb416ced7f350381d5@sha256:d816f3b4b2de675928e2ecfd26ec6b937be35fe9986542c87d440bc3de5a29de
Expand All @@ -197,7 +197,7 @@ jobs:

license-headers:
name: License Headers
runs-on: ubuntu-24.04
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-24.04' }}
timeout-minutes: 30
container:
image: ghcr.io/ai-openshell/openshell/ci:82e753ba3ffdfb40c118e7cb416ced7f350381d5@sha256:d816f3b4b2de675928e2ecfd26ec6b937be35fe9986542c87d440bc3de5a29de
Expand All @@ -215,7 +215,7 @@ jobs:

cargo-deny:
name: Cargo Deny
runs-on: ubuntu-24.04
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-24.04' }}
timeout-minutes: 30
defaults:
run:
Expand Down Expand Up @@ -243,7 +243,7 @@ jobs:

rust-format:
name: Rust format
runs-on: ubuntu-24.04
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-24.04' }}
timeout-minutes: 15
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
Expand Down Expand Up @@ -272,7 +272,7 @@ jobs:

cargo-lockfiles:
name: Cargo lockfiles
runs-on: ubuntu-24.04
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-24.04' }}
timeout-minutes: 15
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
Expand All @@ -294,7 +294,7 @@ jobs:
fail-fast: false
matrix:
include:
- runner: ubuntu-24.04
- runner: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-24.04' }}
system: x86_64-linux
- runner: ubuntu-24.04-arm
system: aarch64-linux
Expand All @@ -312,8 +312,10 @@ jobs:

- uses: ./.github/actions/setup-rust
with:
cache-key: rust-checks-v2
save-cache: "false"
# Trial full artifacts only on GKE; retain hosted cache behavior.
cache-key: ${{ matrix.runner == 'openshell-ci-amd64' && 'gke-rust-lint-artifacts-v1' || 'rust-checks-v2' }}
save-cache: ${{ matrix.runner == 'openshell-ci-amd64' && 'true' || 'false' }}
cache-workspace-crates: ${{ matrix.runner == 'openshell-ci-amd64' && 'true' || 'false' }}

- name: Lint
shell: nix develop -c bash -euo pipefail {0}
Expand All @@ -332,13 +334,17 @@ jobs:
cargo clippy --locked --manifest-path tests/suites/features/Cargo.toml --workspace --all-targets -- -D warnings
cargo clippy --locked --manifest-path tests/support/Cargo.toml --all-targets -- -D warnings

- name: Shared sccache statistics
if: ${{ always() && env.RUSTC_WRAPPER != '' && runner.environment == 'self-hosted' && startsWith(runner.name, 'openshell-ci-amd64-') }}
run: sccache --show-stats

rust-test:
name: Rust test (${{ matrix.system }})
strategy:
fail-fast: false
matrix:
include:
- runner: ubuntu-24.04
- runner: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-24.04' }}
system: x86_64-linux
- runner: ubuntu-24.04-arm
system: aarch64-linux
Expand All @@ -356,8 +362,10 @@ jobs:

- uses: ./.github/actions/setup-rust
with:
cache-key: rust-checks-v2
# Trial full artifacts only on GKE; retain hosted cache behavior.
cache-key: ${{ matrix.runner == 'openshell-ci-amd64' && 'gke-rust-test-artifacts-v1' || 'rust-checks-v2' }}
save-cache: "true"
cache-workspace-crates: ${{ matrix.runner == 'openshell-ci-amd64' && 'true' || 'false' }}

- name: Verify crypto backend independence
shell: nix develop -c bash -euo pipefail {0}
Expand Down Expand Up @@ -421,11 +429,15 @@ jobs:
cargo nextest run --locked --config-file .config/nextest.toml --profile ci --manifest-path tests/support/Cargo.toml
tasks/scripts/check-conformance-program.sh

- name: Shared sccache statistics
if: ${{ always() && env.RUSTC_WRAPPER != '' && runner.environment == 'self-hosted' && startsWith(runner.name, 'openshell-ci-amd64-') }}
run: sccache --show-stats

rust-postgres-test:
name: Rust PostgreSQL tests
# Bare runner: the test script starts a disposable PostgreSQL container
# with the host's Docker.
runs-on: ubuntu-24.04
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-24.04' }}
timeout-minutes: 30
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
Expand All @@ -449,13 +461,17 @@ jobs:
OPENSHELL_TELEMETRY_ENABLED: "false"
run: tasks/scripts/run-postgres-tests.sh --locked --profile ci

- name: Shared sccache statistics
if: ${{ always() && env.RUSTC_WRAPPER != '' && runner.environment == 'self-hosted' && startsWith(runner.name, 'openshell-ci-amd64-') }}
run: sccache --show-stats

rust-build-modes:
name: Rust build modes (${{ matrix.system }})
strategy:
fail-fast: false
matrix:
include:
- runner: ubuntu-24.04
- runner: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-24.04' }}
system: x86_64-linux
- runner: ubuntu-24.04-arm
system: aarch64-linux
Expand Down Expand Up @@ -507,9 +523,13 @@ jobs:
exit 1
fi

- name: Shared sccache statistics
if: ${{ always() && env.RUSTC_WRAPPER != '' && runner.environment == 'self-hosted' && startsWith(runner.name, 'openshell-ci-amd64-') }}
run: sccache --show-stats

rust-feature-alias:
name: Rust feature alias
runs-on: ubuntu-24.04
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-24.04' }}
timeout-minutes: 30
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
Expand All @@ -530,9 +550,13 @@ jobs:
tasks/scripts/verify-defaults-without-telemetry.sh
git diff --exit-code HEAD -- ':(glob)**/Cargo.lock'

- name: Shared sccache statistics
if: ${{ always() && env.RUSTC_WRAPPER != '' && runner.environment == 'self-hosted' && startsWith(runner.name, 'openshell-ci-amd64-') }}
run: sccache --show-stats

rust-gateway-core-features:
name: Rust gateway core features
runs-on: ubuntu-24.04
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-24.04' }}
timeout-minutes: 30
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
Expand All @@ -555,9 +579,13 @@ jobs:
cargo nextest run --locked --profile ci -p openshell-gateway --all-targets --no-default-features --features compute-driver-kubernetes
cargo nextest run --locked --profile ci -p openshell-gateway --all-targets --no-default-features --features compute-driver-podman

- name: Shared sccache statistics
if: ${{ always() && env.RUSTC_WRAPPER != '' && runner.environment == 'self-hosted' && startsWith(runner.name, 'openshell-ci-amd64-') }}
run: sccache --show-stats

rust-gateway-extended-features:
name: Rust gateway extended features
runs-on: ubuntu-24.04
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-24.04' }}
timeout-minutes: 30
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
Expand All @@ -579,12 +607,18 @@ jobs:
cargo nextest run --locked --profile ci -p openshell-gateway --all-targets --no-default-features --features compute-driver-mxc
cargo nextest run --locked --profile ci -p openshell-gateway --all-targets --no-default-features --features compute-driver-docker,compute-driver-vm

- name: Shared sccache statistics
if: ${{ always() && env.RUSTC_WRAPPER != '' && runner.environment == 'self-hosted' && startsWith(runner.name, 'openshell-ci-amd64-') }}
run: sccache --show-stats

python:
name: Python (${{ matrix.runner }})
strategy:
fail-fast: false
matrix:
runner: [ubuntu-24.04, ubuntu-24.04-arm]
runner:
- ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-24.04' }}
- ubuntu-24.04-arm
runs-on: ${{ matrix.runner }}
timeout-minutes: 30
container:
Expand Down Expand Up @@ -635,7 +669,7 @@ jobs:
# Merge queue runs skip this job; the PR already passed it.
name: Python SDK Freeze
if: github.event_name == 'pull_request'
runs-on: ubuntu-latest
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-latest' }}
timeout-minutes: 5
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
Expand All @@ -662,7 +696,7 @@ jobs:

markdown:
name: Markdown
runs-on: ubuntu-24.04
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-24.04' }}
timeout-minutes: 30
container:
image: ghcr.io/ai-openshell/openshell/ci:82e753ba3ffdfb40c118e7cb416ced7f350381d5@sha256:d816f3b4b2de675928e2ecfd26ec6b937be35fe9986542c87d440bc3de5a29de
Expand All @@ -681,7 +715,7 @@ jobs:
typescript-sdk-freeze:
name: TypeScript SDK Freeze
if: github.event_name == 'pull_request'
runs-on: ubuntu-latest
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-latest' }}
timeout-minutes: 5
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
Expand Down Expand Up @@ -714,7 +748,7 @@ jobs:

install-script:
name: install.sh
runs-on: ubuntu-latest
runs-on: ${{ github.repository == 'ai-openshell/openshell' && (github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository) && 'openshell-ci-amd64' || 'ubuntu-latest' }}
timeout-minutes: 10
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
Expand Down
Loading
Loading