Interactive: deprovision retired Eco workloads and Grafana #627

Closed
opened 2026-07-24 09:43:37 +00:00 by coilyco-ops · 2 comments
Owner

Operator-owned live cleanup after the Eco consolidation and Grafana tracked-code retirement.

Prechecks:

  • Confirm namespace coilysiren-eco-app is Ready and https://eco-app.coilysiren.me/ plus /jobs/ return expected 2xx responses.
  • Identify the live predecessor namespaces by exact name. Repository history names them coilysiren-eco-mcp-app and coilysiren-eco-spec-tracker.
  • Confirm the Grafana Helm release and its PVC ownership without touching VictoriaMetrics, vmagent, node-exporter, SigNoz, or GlitchTip in the shared observability namespace.

Live removals:

  • Delete only the two retired Eco predecessor namespaces.
  • Uninstall only the grafana Helm release and delete only Grafana-owned PVCs and certificate material.
  • Apply the reviewed aws-inventory Terraform change that removes the eco-mcp and eco-jobs-tracker Route53 records.
  • Apply the reviewed Tailscale Terraform change that retires eco-spec and its generated SSM authkey. Preserve eco-mcp, which the fused eco-app sidecar reuses.
  • Delete the retired /sentry-dsn/eco-spec-tracker SSM parameter.
  • Tear down the orphaned Grafana Terraform remote state called out in infrastructure #388.

Postchecks:

  • The predecessor namespaces, Grafana release, and Grafana PVCs are absent.
  • coilysiren-eco-app remains Ready and its canonical public and tailnet surfaces work.
  • VictoriaMetrics, vmagent, node-exporter, SigNoz, and GlitchTip remain healthy.
  • The retired public hosts no longer resolve after DNS convergence.
  • Record exact deleted resource names and before/after evidence here.

This issue requires an interactive label and an ops-capable run. The sealed engineer must not perform or claim these live deletions.

Operator-owned live cleanup after the Eco consolidation and Grafana tracked-code retirement. Prechecks: * Confirm namespace `coilysiren-eco-app` is Ready and `https://eco-app.coilysiren.me/` plus `/jobs/` return expected 2xx responses. * Identify the live predecessor namespaces by exact name. Repository history names them `coilysiren-eco-mcp-app` and `coilysiren-eco-spec-tracker`. * Confirm the Grafana Helm release and its PVC ownership without touching VictoriaMetrics, vmagent, node-exporter, SigNoz, or GlitchTip in the shared `observability` namespace. Live removals: * Delete only the two retired Eco predecessor namespaces. * Uninstall only the `grafana` Helm release and delete only Grafana-owned PVCs and certificate material. * Apply the reviewed aws-inventory Terraform change that removes the `eco-mcp` and `eco-jobs-tracker` Route53 records. * Apply the reviewed Tailscale Terraform change that retires `eco-spec` and its generated SSM authkey. Preserve `eco-mcp`, which the fused eco-app sidecar reuses. * Delete the retired `/sentry-dsn/eco-spec-tracker` SSM parameter. * Tear down the orphaned Grafana Terraform remote state called out in infrastructure #388. Postchecks: * The predecessor namespaces, Grafana release, and Grafana PVCs are absent. * `coilysiren-eco-app` remains Ready and its canonical public and tailnet surfaces work. * VictoriaMetrics, vmagent, node-exporter, SigNoz, and GlitchTip remain healthy. * The retired public hosts no longer resolve after DNS convergence. * Record exact deleted resource names and before/after evidence here. This issue requires an `interactive` label and an ops-capable run. The sealed engineer must not perform or claim these live deletions.
Author
Owner

Tracked deprovision preparation is now split across the owning repositories:

  • coilysiren/website commit 4e8ea74 landed on main. The public catalog, Eco article, iframe, and browser probe now use eco-app.coilysiren.me; the Grafana entry is gone.
  • coilyco-flight-deck/infrastructure commit 4b36a3d landed on main and contains #626. Desired state removes the two retired Route53 records and the eco-spec Tailscale service while preserving the fused app's eco-mcp identity.
  • coilyco-bridge/deploy PR #202 removes the obsolete legacy-host cutover bundle. It remains human-gated.

The engineer performed no live namespace, Helm, PVC, certificate, DNS apply, SSM deletion, Tailscale apply, or Terraform-state mutation. This issue remains the operator checkpoint for those actions and their before/after evidence.

Tracked deprovision preparation is now split across the owning repositories: * `coilysiren/website` commit `4e8ea74` landed on main. The public catalog, Eco article, iframe, and browser probe now use `eco-app.coilysiren.me`; the Grafana entry is gone. * `coilyco-flight-deck/infrastructure` commit `4b36a3d` landed on main and contains #626. Desired state removes the two retired Route53 records and the `eco-spec` Tailscale service while preserving the fused app's `eco-mcp` identity. * `coilyco-bridge/deploy` PR #202 removes the obsolete legacy-host cutover bundle. It remains human-gated. The engineer performed no live namespace, Helm, PVC, certificate, DNS apply, SSM deletion, Tailscale apply, or Terraform-state mutation. This issue remains the operator checkpoint for those actions and their before/after evidence.
Author
Owner

CI checkpoint:

  • Website main config.yml run 10829 and trufflehog.yml run 10830 succeeded.
  • Infrastructure main lint.yml run 10832 and trufflehog.yml run 10833 succeeded.
  • Deploy PR #202 ci.yml run 10834 succeeded.

Tracked desired-state preparation is green. Live deletion remains unperformed and must follow this issue's prechecks and preservation guards after PR #202 is merged.

CI checkpoint: * Website main `config.yml` run 10829 and `trufflehog.yml` run 10830 succeeded. * Infrastructure main `lint.yml` run 10832 and `trufflehog.yml` run 10833 succeeded. * Deploy PR #202 `ci.yml` run 10834 succeeded. Tracked desired-state preparation is green. Live deletion remains unperformed and must follow this issue's prechecks and preservation guards after PR #202 is merged.
coilyco-ops 2026-07-29 03:46:28 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
coilyco-flight-deck/infrastructure#627
No description provided.