pub fn gpu_memory(device: &CombsDevice) -> Option<GpuMemory>Expand description
Samples the GPU allocator. memory_usage() is submit_blocking on the
compute stream — call from the engine worker between generations (or
rate-limited), not from request threads during a long prefill.