Structsยง
- Active
Generation - Tracks the currently active generation on a GPU worker.
- GpuJob
- A job dispatched to a GPU worker thread for processing.
- GpuPool
- Pool of GPU workers with placement strategy.
- GpuWorker
- Per-GPU worker state. Each GPU gets its own model cache, load lock, and health tracking.