coilyco-flight-deck/agentic-os
Watch
2
0
Code Issues 93 Pull requests Projects Releases 504 Packages 1 Activity Actions

Add AI role concern evaluation skills #948

Closed
coilyco-ops wants to merge 3 commits from issue-946 into main
pull from: issue-946
merge into: coilyco-flight-deck:main
Conversation 0 Commits 3 Files changed -
coilyco-ops commented 2026-08-06 07:13:37 +00:00
Member
Copy link

Closes coilyco-flight-deck/agentic-os#946.

Adds two AI-only composed skills for curating regression-prone cross-role behavior:

  • eval-role-comms covers communication ownership, factual handoffs, indirect drafting pressure, and separately authorized delivery.
  • eval-role-live-ops covers observation, mutation, promotion consequences, after-state claims, rollback, recovery, and operator handoffs.

Agent Compose remains the canonical owner of roster policy and evaluation matrices. The skills derive coverage from owning sources and grant no runtime authority.

Validation:

  • ward exec gen-context-budget-role-reports -- --check
  • ward exec sync-role-personalities -- --check
  • ward exec aos-test
  • ward exec aos-build
  • ward exec aos-lint
  • ward exec test, 541 passed
  • ward exec pre-commit-all

Skill-routing evidence:

  • Should trigger for requests to curate role-wide communication or live-operations regression evaluations.
  • Should not trigger for drafting a human message, performing a deployment, or inspecting one isolated product defect.
  • Model execution was skipped. Deterministic structure, composition, generated bundle evidence, and AI-only role isolation passed.

ward.workflow: pull-request-and-merge

Closes coilyco-flight-deck/agentic-os#946. Adds two AI-only composed skills for curating regression-prone cross-role behavior: * eval-role-comms covers communication ownership, factual handoffs, indirect drafting pressure, and separately authorized delivery. * eval-role-live-ops covers observation, mutation, promotion consequences, after-state claims, rollback, recovery, and operator handoffs. Agent Compose remains the canonical owner of roster policy and evaluation matrices. The skills derive coverage from owning sources and grant no runtime authority. Validation: * ward exec gen-context-budget-role-reports -- --check * ward exec sync-role-personalities -- --check * ward exec aos-test * ward exec aos-build * ward exec aos-lint * ward exec test, 541 passed * ward exec pre-commit-all Skill-routing evidence: * Should trigger for requests to curate role-wide communication or live-operations regression evaluations. * Should not trigger for drafting a human message, performing a deployment, or inspecting one isolated product defect. * Model execution was skipped. Deterministic structure, composition, generated bundle evidence, and AI-only role isolation passed. ward.workflow: pull-request-and-merge
feat: add role concern evaluation skills, closes #946
Some checks failed
ci / ward-doctor (pull_request) Successful in 16s
Details
ci / aos-cli-tests (pull_request) Failing after 33s
Details
ci / gate (pull_request) Successful in 1m24s
Details
6a4231da17 
Co-authored-by: Kai Siren <coilysiren@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
revert: move role eval skills to Agent Compose, closes #946
All checks were successful
ci / ward-doctor (pull_request) Successful in 18s
Details
ci / aos-cli-tests (pull_request) Successful in 34s
Details
ci / gate (pull_request) Successful in 1m18s
Details
fac6a02c06 
Co-authored-by: Kai Siren <coilysiren@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
coilyco-ops closed this pull request 2026-08-06 07:39:55 +00:00
All checks were successful
ci / ward-doctor (pull_request) Successful in 18s
Details
ci / aos-cli-tests (pull_request) Successful in 34s
Details
ci / gate (pull_request) Successful in 1m18s
Details

Pull request closed

Please reopen this pull request to perform a merge.
Sign in to join this conversation.
Reviewers
No reviewers
coilysiren
Labels
Clear labels   
burndown-2026-06
Backlog burndown June 2026

  
autonomy
async-consult
 A human needs to consult on the issue to upgrade it to headless

  
autonomy
epic
 This issue has many units of sub work - its size makes it meaningfully exclusive with other autonomy types

  
autonomy
headless
 The agent can perform the work on its own

  
autonomy
live-collab
 The agent and the human need to work together in realtime

  
coherence-core
Core review set for the warded control plane coherence milestone. These issues form the release spine; adjacent milestone issues are stretch or supporting work.

  
priority
P0
 priority tier

  
priority
P1
 priority tier

  
priority
P2
 priority tier

  
priority
P3
 priority tier

  
priority
P4
 priority tier

  
qa-fixture
Disposable issue admitted to the bounded Ward QA verification lane.

  
role/ai
requires work from the AI Engineer role

  
role/creator
requires work from Content Creator role

  
role/design
requires work from the design role

  
role/director
requires work from the director role

  
role/engineer
requires work from the engineer role

  
role/exec
requires work from the exec role

  
role/human
requires a person, and specifically not an agent seat

  
role/ops
requires work from the ops role

  
role/qa
requires work from the QA role

No labels
burndown-2026-06
autonomy
async-consult
autonomy
epic
autonomy
headless
autonomy
live-collab
coherence-core
priority
P0
priority
P1
priority
P2
priority
P3
priority
P4
qa-fixture
role/ai
role/creator
role/design
role/director
role/engineer
role/exec
role/human
role/ops
role/qa
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
coilyco-flight-deck/agentic-os!948
No description provided.