refactor(eval)!: adopt entity and attribute from the shared layer #1127

Merged

coilyco-ops merged 1 commit from aos/claude/sj87-entity-attribute into main

2026-08-23 00:38:07 +00:00

coilyco-ops commented

2026-08-23 00:36:02 +00:00

Member

aos-eval stopped hardcoding one deployment's vocabulary in the layer that is supposed to be agnostic, landed as agentic-os#1195 and cut as aos-eval-v0.6.0. A challenge now tests one entity for one attribute.

Breaking: the declaration is eval/attributes.yaml on schema sirens-discord-ops.attributes.v1, with an attributes: key and an entity: field. just boundaries and just boundaries-check are now just attributes and just attributes-check.

Why this repository is the point

This deployment is the case the abstraction exists for. Its entity is a lane and its attribute is a clause. Neither is a role or a boundary, so the shared taxonomy was branching on role-fit and personality that this repository has never declared, and any new test type fell through to a bare label with no axis detail.

Not moving

EvaluationCase and RateCase keep cases:. Neither is graded by a human and neither has a pair, so neither is a challenge. The probe layer's line stays where it is.

Validation

just gate passes: build, policy-check, vet, test, test-skips, pre-commit.

closes #1125

`aos-eval` stopped hardcoding one deployment's vocabulary in the layer that is supposed to be agnostic, landed as [agentic-os#1195](https://forgejo.coilysiren.me/coilyco-flight-deck/agentic-os/issues/1195) and cut as `aos-eval-v0.6.0`. A challenge now tests one **entity** for one **attribute**. **Breaking:** the declaration is `eval/attributes.yaml` on schema `sirens-discord-ops.attributes.v1`, with an `attributes:` key and an `entity:` field. `just boundaries` and `just boundaries-check` are now `just attributes` and `just attributes-check`. ## Why this repository is the point This deployment is the case the abstraction exists for. Its entity is a lane and its attribute is a clause. Neither is a role or a boundary, so the shared taxonomy was branching on `role-fit` and `personality` that this repository has never declared, and any new test type fell through to a bare label with no axis detail. ## Not moving `EvaluationCase` and `RateCase` keep `cases:`. Neither is graded by a human and neither has a pair, so neither is a challenge. The probe layer's line stays where it is. ## Validation `just gate` passes: build, policy-check, vet, test, test-skips, pre-commit. closes #1125

coilyco-ops added 1 commit

2026-08-23 00:36:02 +00:00

refactor(eval)!: adopt entity and attribute from the shared layer

ci / image-build (pull_request) Successful in 40s

Details

ci / test (pull_request) Successful in 1m12s

Details

ci / publish-echo-image (pull_request) Has been skipped

Details

ci / publish-observed (pull_request) Has been skipped

Details

c6b886dc91

`aos-eval` stopped hardcoding one deployment's vocabulary in the layer that is
supposed to be agnostic, cut as `aos-eval-v0.6.0`. A challenge now tests one
entity for one attribute.

BREAKING CHANGE: the declaration is `eval/attributes.yaml` on schema
`sirens-discord-ops.attributes.v1`, with an `attributes:` key and an `entity:`
field. The `just boundaries` and `boundaries-check` verbs are `attributes` and
`attributes-check`.

This deployment is the case the abstraction exists for. Its entity is a lane and
its attribute is a clause, and neither is a role or a boundary, so the shared
taxonomy was branching on `role-fit` and `personality` that this repository has
never declared.

`EvaluationCase` and `RateCase` keep `cases:`. Neither is graded by a human and
neither has a pair, so neither is a challenge, and the probe layer's line stays
where it is.

`just gate` passes.

closes #1125

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Kai Siren <coilysiren@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Agent-Role: ai

coilyco-ops merged commit 952862fe15 into main

2026-08-23 00:38:07 +00:00

coilyco-ops referenced this pull request from a commit

2026-08-23 00:38:09 +00:00

Merge pull request 'refactor(eval)!: adopt entity and attribute from the shared layer' (#1127) from aos/claude/sj87-entity-attribute into main

No reviewers

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference

coilyco-gaming/sirens-echo!1127

No description provided.

Rows
Columns