Forgejo Actions runners offline, release pipelines stalled since 2026-05-27 #165

Open
opened 2026-05-28 09:16:18 +00:00 by coilysiren · 0 comments
Owner

Symptom

Both Forgejo Actions runners are offline, so no workflow has executed since 2026-05-27 ~03:34 UTC. Every release pipeline (coily and siblings) is stalled.

Evidence (via /api/v1/admin/actions/runners):

  • forgejo-runner-0 (uuid 524f4035...) status=offline, v12.10.1, labels [docker]
  • forgejo-runner-1 (uuid ebd5fe3e...) status=offline, v12.10.1, labels [docker]

Newest Actions task is id 134 (windows-assets, head feb7a45e) created 2026-05-27T03:34:17Z. Pushes to coily main since then (8be1ccd0, df5a17f3) produced no runs.

Impact

  • coily release pipeline does not cut tags / build assets.
  • The new sync-lockdown job (coily#143) cannot run, so the canonical-bump fan-out is untested and not propagating.
  • bump-formula has been failing on every historical run anyway (empty token bug, fixed in coily df5a17f3 but needs a runner to verify).

Likely fix

Runner deploy is infrastructure/deploy/forgejo-runner.yml on k3s (kai-server). Check the runner pod(s): kubectl -n forgejo get pods, restart the runner Deployment/DaemonSet, confirm re-registration (status flips to online). Note: this session's user cannot read /etc/rancher/k3s/k3s.yaml (permission denied), so kubectl-based diagnosis needs a context that can.

**Symptom** Both Forgejo Actions runners are `offline`, so no workflow has executed since 2026-05-27 ~03:34 UTC. Every release pipeline (coily and siblings) is stalled. **Evidence** (via `/api/v1/admin/actions/runners`): - `forgejo-runner-0` (uuid 524f4035...) status=offline, v12.10.1, labels [docker] - `forgejo-runner-1` (uuid ebd5fe3e...) status=offline, v12.10.1, labels [docker] Newest Actions task is id 134 (`windows-assets`, head `feb7a45e`) created 2026-05-27T03:34:17Z. Pushes to coily main since then (`8be1ccd0`, `df5a17f3`) produced no runs. **Impact** - coily release pipeline does not cut tags / build assets. - The new `sync-lockdown` job (coily#143) cannot run, so the canonical-bump fan-out is untested and not propagating. - `bump-formula` has been failing on every historical run anyway (empty token bug, fixed in coily df5a17f3 but needs a runner to verify). **Likely fix** Runner deploy is `infrastructure/deploy/forgejo-runner.yml` on k3s (kai-server). Check the runner pod(s): `kubectl -n forgejo get pods`, restart the runner Deployment/DaemonSet, confirm re-registration (status flips to online). Note: this session's user cannot read `/etc/rancher/k3s/k3s.yaml` (permission denied), so kubectl-based diagnosis needs a context that can.
Sign in to join this conversation.
No labels
P0
P1
P2
P3
P4
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
coilyco-flight-deck/infrastructure#165
No description provided.