Skip to content

github-backup: estate mirror system (scripts, units, Worker, runbook) - #3214

Merged
dezren39 merged 1 commit into
mainfrom
feat/github-backup
Oct 31, 2026
Merged

dezren39 merged 1 commit into
mainfrom
feat/github-backup

Conversation

@dezren39

@dezren39 dezren39 commented Oct 31, 2026 •

Copy link
Copy Markdown
Member

Implements the GitHub backup system decided 2026-10-31 (Tier C scope + nixpkgs family pool; dedicated GitHub App; webhooks via a Cloudflare Worker; weekly reconciliation sweep as correctness floor).

Home: infra/github-backup/ — config.json (owners/tier rules/exclusions/gaps — adding an org is a config edit), bin/ (plan builder, clone_all, fetch_mirrors, reconcile, manifest, drain_queue, app_setup), systemd/ (laptop user units + installer), worker/ (webhook receiver source + wrangler.toml), README.md, docs/RUNBOOK.md (copy-paste: install, App creation/install per org, add-org, upgrade, fresh-laptop reinstall, restore, disaster recovery).

Verification: plan builder run against the measured 863-repo inventory reproduces the production plan exactly — 818 mirrors, 7 exclusions, 37 zero-commit skips, 35 alternates family members; all Python files compile; Worker JS syntax-checked. The initial clone fleet is running on the laptop from this same logic; units/App/Worker deployment follows in the rollout (tracked on the system issue).


View with [code]smith Autofix with [code]smith
Need help on this PR? Tag @codesmith-bot with what you need.

…rker receiver, runbook

Canonical home for Drew's GitHub backup system (Tier C + nixpkgs pool,
decided 2026-10-31): config-driven owners/tier rules/exclusions in
config.json; plan builder + resumable parallel mirror clone; daily
fetch, weekly reconciliation sweep, webhook queue drainer; dedicated
GitHub App (hatch-repo-backup) tooling with Bitwarden-by-name secrets;
Cloudflare Worker webhook receiver (source + wrangler config);
systemd user units; README + copy-paste RUNBOOK (install, add-org,
App install, upgrade, fresh-laptop, restore, DR).

Plan builder verified against the 2026-10-31 inventory: 818 mirrors,
7 ruling exclusions, 37 zero-commit skips, 35 alternates-linked family
members, nixpkgs members anchored on NixOS/nixpkgs.
@dezren39
dezren39 requested a review from a team as a code owner October 31, 2026 20:46
@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ⚠️ Failed 2026-10-31T20:46:03.704992Z
We couldn’t complete this review. Comment @codex review to try again.
63bc371 PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector

Copy link
Copy Markdown

You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard.
To continue using code reviews, you can upgrade your account or add credits to your account and enable them for code reviews in your settings.

@coderabbitai

coderabbitai Bot commented Oct 31, 2026

Copy link
Copy Markdown

Warning

Review limit reached

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Next included review available in 7 minutes.

Check out review usage here.

View limit details

Limit details: You’ve used the included review currently available.

Learn how review limits work.

Review configuration:

Run configuration
  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: defaults
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 306eeea0-3e42-4904-82e3-7cce0341f486
Commits

Reviewing files that changed from the base of the PR and between c5e324b and 63bc371.

Files selected for processing: 20
  • infra/github-backup/README.md
  • infra/github-backup/bin/app_setup.py
  • infra/github-backup/bin/clone_all.py
  • infra/github-backup/bin/drain_queue.py
  • infra/github-backup/bin/fetch_mirrors.py
  • infra/github-backup/bin/ghb_common.py
  • infra/github-backup/bin/manifest.py
  • infra/github-backup/bin/reconcile.py
  • infra/github-backup/config.json
  • infra/github-backup/docs/RUNBOOK.md
  • infra/github-backup/systemd/drain-wrapper.sh
  • infra/github-backup/systemd/github-backup-drain.service
  • infra/github-backup/systemd/github-backup-drain.timer
  • infra/github-backup/systemd/github-backup-fetch.service
  • infra/github-backup/systemd/github-backup-fetch.timer
  • infra/github-backup/systemd/github-backup-reconcile.service
  • infra/github-backup/systemd/github-backup-reconcile.timer
  • infra/github-backup/systemd/install-units.sh
  • infra/github-backup/worker/src/index.js
  • infra/github-backup/worker/wrangler.toml
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

Share

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant