Add agent-proxy-evaluate-skill-use skill and skill-fit view #70

Closed
opened 2026-08-01 05:46:21 +00:00 by coilyco-ops · 0 comments
Member

Goal

Expose the retained Ward skill-use and agent-compose selection evidence through a governed view, then add a skill that evaluates skill adoption and observed outcomes.

Product prerequisite

The raw ledger retains ward.skill observations and selected-skill claims, but the current materializer and operational views do not preserve skill names for querying. Land the query contract before advertising the skill.

Scope

  • Preserve skill identity and selection or use facts through materialization.
  • Add a governed skill_fit view grouped by skill, role, harness, and model.
  • Report observed usage, trajectory counts, completion, retry, fallback, evaluation, access, freshness, and source trajectories.
  • Add agent-proxy-evaluate-skill-use through the shared read-only query helper.
  • Keep unresolved disagreement and missing evidence explicit.

Acceptance

  • Metadata-only and access-tier boundaries remain intact.
  • The view never treats correlation as causation or grants authority.
  • Replayed evidence produces deterministic results.
  • The skill can answer whether a skill was selected or used and what outcomes were observed.
  • Features, operational-view docs, tests, skill validation, and Ward gates pass.
## Goal Expose the retained Ward skill-use and agent-compose selection evidence through a governed view, then add a skill that evaluates skill adoption and observed outcomes. ## Product prerequisite The raw ledger retains `ward.skill` observations and selected-skill claims, but the current materializer and operational views do not preserve skill names for querying. Land the query contract before advertising the skill. ## Scope * Preserve skill identity and selection or use facts through materialization. * Add a governed `skill_fit` view grouped by skill, role, harness, and model. * Report observed usage, trajectory counts, completion, retry, fallback, evaluation, access, freshness, and source trajectories. * Add `agent-proxy-evaluate-skill-use` through the shared read-only query helper. * Keep unresolved disagreement and missing evidence explicit. ## Acceptance * Metadata-only and access-tier boundaries remain intact. * The view never treats correlation as causation or grants authority. * Replayed evidence produces deterministic results. * The skill can answer whether a skill was selected or used and what outcomes were observed. * Features, operational-view docs, tests, skill validation, and Ward gates pass.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
coilyco-flight-deck/agent-proxy#70
No description provided.