coilyco-flight-deck/agent-proxy
Watch
2
0
Code Issues 11 Pull requests Projects Releases Packages 1 Wiki Activity Actions

Record prominently when a request comes in for a model that isn't currently in vram #61

New issue
Closed
opened 2026-07-26 05:32:40 +00:00 by coilysiren · 0 comments
coilysiren commented 2026-07-26 05:32:40 +00:00
Owner
Copy link

Few moving parts here, such as: whats the best way to know a model is in vram? does ollama tell you that? do you protectively as ollama if a model is in vram async on every request?

Few moving parts here, such as: whats the best way to know a model is in vram? does ollama tell you that? do you protectively as ollama if a model is in vram async on every request?
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
aos/claude/docs-merge-to-cap
task/142-single-ledger-read
task/view-rebuild-connection-churn
task/issue-140-sse-chunk-spans
task/served-model-attribute
aos/claude/mg96-fm
configurable-rate-limits
prefer-backend-header
saturation-stickiness
context-budget-per-model
trim-tool-call-groups
saturation-failover
sse-heartbeats
backend-regime-spans
queue-wait-measures-the-wait
cancel-abandoned-work
upstream-error-classification
prompt-cache-accounting
build-publish-image
doc-layout-caps
exception-taxonomy
skill-fit-view
comment-block-discipline
otel-error-span-path-coverage
restore-all-files-precommit-verb
remove-ungrounded-action-claim-check
aos/claude/adopt-precommit
aos/claude/user-message-capture
issue-82
issue-80
recovery/2026-07-27-local-work
ward-salvage/agent-proxy-09877ee0
No results found.
Labels
Clear labels   
burndown-2026-08
Closed in the 2026-08-26 backlog burn-down. Reopen freely: state:closed label:burndown-2026-08 recovers the whole set.

  
autonomy
async-consult
 A human needs to consult on the issue to upgrade it to headless

  
autonomy
epic
 This issue has many units of sub work - its size makes it meaningfully exclusive with other autonomy types

  
autonomy
headless
 The agent can perform the work on its own

  
autonomy
live-collab
 The agent and the human need to work together in realtime

  
coherence-core
Core review set for the warded control plane coherence milestone. These issues form the release spine; adjacent milestone issues are stretch or supporting work.

  
priority
P0
 priority tier

  
priority
P1
 priority tier

  
priority
P2
 priority tier

  
priority
P3
 priority tier

  
priority
P4
 priority tier

  
qa-fixture
Disposable issue admitted to the bounded Ward QA verification lane.

  
role/advocate
requires work from the Developer Advocate seat

  
role/director
requires work from the Portfolio Director seat

  
role/exec
requires work from the exec role

  
role/frontend
requires work from the Frontend Engineer seat

  
role/gamedev
requires work from the Game Developer seat

  
role/human
requires a person, and specifically not an agent seat

  
role/platform
requires work from the Platform Engineer seat

  
role/qa
requires work from the QA role

  
role/science
requires work from the Applied Scientist seat

  
role/sysadmin
requires work from the Systems Administrator seat

  
state
ambient
 ambient and ephemeral work, held as a maintained document rather than a queue

No labels
burndown-2026-08
autonomy
async-consult
autonomy
epic
autonomy
headless
autonomy
live-collab
coherence-core
priority
P0
priority
P1
priority
P2
priority
P3
priority
P4
qa-fixture
role/advocate
role/director
role/exec
role/frontend
role/gamedev
role/human
role/platform
role/qa
role/science
role/sysadmin
state
ambient
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
coilyco-flight-deck/agent-proxy#61
No description provided.