Skip to main content

Module model_manager

Module model_manager 

Source

Structs§

ActivationHint
Per-request shape hint passed into [preflight_memory_guard] so the activation budget can scale with resolution / dtype / arch. None degrades to the previous fixed-headroom approximation (the MEMORY_BUDGET_HEADROOM baked into estimate_peak_memory’s 2 GB constant), which keeps behavior identical for callers that don’t yet have a request in scope (e.g. admin-API model loads with no resolution context).