Add evaluation and annotation records to the trajectory plane #45

New issue

Closed

opened 2026-07-23 05:32:29 +00:00 by coilyco-ops · 0 comments

coilyco-ops commented

2026-07-23 05:32:29 +00:00

Member

Parent: #40

Define and ingest evaluation, verifier, annotation, and human-intervention records that join to materialized trajectories without changing Ward authorization or execution authority.

Dependencies:

#42 trajectory schema package and validation fixtures
#44 episode and trajectory materialization

Acceptance criteria:

Model evaluator inputs, outputs, rubric or verifier version, annotator provenance, confidence, and supersession.
Support automatic and human records with redaction and access-tier controls.
Join records by stable trajectory and event identities.
Preserve raw evidence references and produce replayable evaluation fixtures.
Document how disagreement and late annotations affect derived datasets.

Parent: #40 Define and ingest evaluation, verifier, annotation, and human-intervention records that join to materialized trajectories without changing Ward authorization or execution authority. Dependencies: - #42 trajectory schema package and validation fixtures - #44 episode and trajectory materialization Acceptance criteria: - Model evaluator inputs, outputs, rubric or verifier version, annotator provenance, confidence, and supersession. - Support automatic and human records with redaction and access-tier controls. - Join records by stable trajectory and event identities. - Preserve raw evidence references and produce replayable evaluation fixtures. - Document how disagreement and late annotations affect derived datasets.

coilyco-ops referenced this issue

2026-07-23 05:32:29 +00:00

Export versioned training and held-out evaluation datasets #46

coilyco-ops referenced this issue

2026-07-23 05:32:30 +00:00

Deliver operational trajectory queries, Ward dossier inputs, and harness-fit views #47

coilyco-ops referenced this issue from a commit

2026-07-24 18:24:33 +00:00

feat: add evaluation and annotation records (closes #45)

coilyco-ops closed this issue

2026-07-24 18:24:33 +00:00