coilyco-flight-deck/agent-proxy
Watch
2
0
Code Issues 11 Pull requests Projects Releases Packages 1 Wiki Activity Actions

Export versioned training and held-out evaluation datasets #46

New issue
Closed
opened 2026-07-23 05:32:29 +00:00 by coilyco-ops · 0 comments
coilyco-ops commented 2026-07-23 05:32:29 +00:00
Member
Copy link

Parent: #40

Materialize versioned SFT, preference, verifier, reward, and held-out evaluation exports from trajectories and joined evaluation records.

Dependencies:

  • #44 episode and trajectory materialization
  • #45 evaluation and annotation records

Acceptance criteria:

  • Produce explicit schemas for each export kind and an immutable manifest.
  • Record source event ids, trajectory ids, filter policy, transform version, content hashes, and redaction policy.
  • Prevent train and held-out evaluation leakage with documented split semantics.
  • Make exports reproducible from retained raw evidence and versioned materializers.
  • Keep sensitive body capture opt-in and access-controlled.
Parent: #40 Materialize versioned SFT, preference, verifier, reward, and held-out evaluation exports from trajectories and joined evaluation records. Dependencies: - #44 episode and trajectory materialization - #45 evaluation and annotation records Acceptance criteria: - Produce explicit schemas for each export kind and an immutable manifest. - Record source event ids, trajectory ids, filter policy, transform version, content hashes, and redaction policy. - Prevent train and held-out evaluation leakage with documented split semantics. - Make exports reproducible from retained raw evidence and versioned materializers. - Keep sensitive body capture opt-in and access-controlled.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
task/142-single-ledger-read
task/view-rebuild-connection-churn
task/issue-140-sse-chunk-spans
task/served-model-attribute
aos/claude/mg96-fm
configurable-rate-limits
prefer-backend-header
saturation-stickiness
context-budget-per-model
trim-tool-call-groups
saturation-failover
sse-heartbeats
backend-regime-spans
queue-wait-measures-the-wait
cancel-abandoned-work
upstream-error-classification
prompt-cache-accounting
build-publish-image
doc-layout-caps
exception-taxonomy
skill-fit-view
comment-block-discipline
otel-error-span-path-coverage
restore-all-files-precommit-verb
remove-ungrounded-action-claim-check
aos/claude/adopt-precommit
aos/claude/user-message-capture
issue-82
issue-80
recovery/2026-07-27-local-work
ward-salvage/agent-proxy-09877ee0
No results found.
Labels
Clear labels
  
autonomy
async-consult
 A human needs to consult on the issue to upgrade it to headless

  
autonomy
epic
 This issue has many units of sub work - its size makes it meaningfully exclusive with other autonomy types

  
autonomy
headless
 The agent can perform the work on its own

  
autonomy
live-collab
 The agent and the human need to work together in realtime

  
coherence-core
Core review set for the warded control plane coherence milestone. These issues form the release spine; adjacent milestone issues are stretch or supporting work.

  
priority
P0
 priority tier

  
priority
P1
 priority tier

  
priority
P2
 priority tier

  
priority
P3
 priority tier

  
priority
P4
 priority tier

  
qa-fixture
Disposable issue admitted to the bounded Ward QA verification lane.

  
role/ai
requires work from the AI Engineer role

  
role/creator
requires work from Content Creator role

  
role/design
requires work from the design role

  
role/director
requires work from the director role

  
role/engineer
requires work from the engineer role

  
role/exec
requires work from the exec role

  
role/human
requires a person, and specifically not an agent seat

  
role/ops
requires work from the ops role

  
role/qa
requires work from the QA role

No labels
autonomy
async-consult
autonomy
epic
autonomy
headless
autonomy
live-collab
coherence-core
priority
P0
priority
P1
priority
P2
priority
P3
priority
P4
qa-fixture
role/ai
role/creator
role/design
role/director
role/engineer
role/exec
role/human
role/ops
role/qa
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
coilyco-flight-deck/agent-proxy#46
No description provided.