Gauntlet Vitals as OpenAI Guardrails YAML twin #7

New issue

Closed

opened 2026-05-23 20:54:22 +00:00 by coilysiren · 1 comment

coilysiren commented

2026-05-23 20:54:22 +00:00

Owner

Originally filed by @coilysiren on 2026-05-03T19:53:36Z - https://github.com/coilysiren/gauntlet/issues/6

🤖 Filed by Claude Code on Kai's behalf.

Inspiration: openai/openai-guardrails-python (and the JS variant) - configurable input/output validation for LLM apps, driven by a YAML config.

Joins against: gauntlet's Vitals concept (externally-observable invariants checked independently of the Inspector).

Guardrails fire at runtime on every LLM call. Gauntlet's Vitals fire at promotion time on every Trial. The invariants are often the same shape (no PII leaking, no cross-tenant data, expected schema). If gauntlet emits its Vitals as a guardrails YAML twin, the same invariant runs both pre-merge (gauntlet) and at-runtime (guardrails). Two-line value prop. Doesn't require gauntlet to depend on openai-guardrails: just a YAML serializer that produces a config the OpenAI library can consume. Cross-ecosystem credibility on a small surface.

🤖 Filed by Claude Code on Kai's behalf.

Moved from coilysiren/coilyco-ai#44.

_Originally filed by @coilysiren on 2026-05-03T19:53:36Z - [https://github.com/coilysiren/gauntlet/issues/6](https://github.com/coilysiren/gauntlet/issues/6)_ > 🤖 Filed by Claude Code on Kai's behalf. **Inspiration:** [`openai/openai-guardrails-python`](https://github.com/openai/openai-guardrails-python) (and the JS variant) - configurable input/output validation for LLM apps, driven by a YAML config. **Joins against:** `gauntlet`'s Vitals concept (externally-observable invariants checked independently of the Inspector). Guardrails fire at runtime on every LLM call. Gauntlet's Vitals fire at promotion time on every Trial. The invariants are often the same shape (no PII leaking, no cross-tenant data, expected schema). If gauntlet emits its Vitals as a guardrails YAML twin, the same invariant runs both pre-merge (gauntlet) and at-runtime (guardrails). Two-line value prop. Doesn't require gauntlet to depend on openai-guardrails: just a YAML serializer that produces a config the OpenAI library can consume. Cross-ecosystem credibility on a small surface. > 🤖 Filed by Claude Code on Kai's behalf. --- *Moved from coilysiren/coilyco-ai#44.*

coilysiren commented

2026-05-30 05:44:11 +00:00

Author

Owner

Iceboxed in the 2026-05-29 backlog burn-down: Explore-openai-repo inspiration, speculative future feature. Reopen anytime if it becomes real.

coilysiren

2026-05-30 05:44:11 +00:00