Expand description
Well-known capability ids, so a client can look one up rather than pattern-matching on position in the list.
Constantsยง
- CONTINUOUS_
BATCHING - Continuous batching (
FERROX_CONTINUOUS_BATCHING=1). - CPU
- CUDA
- METAL
- REAL_
WEIGHTS - Whether the loaded weights are real, or the synthetic random-weight demo model that ferrox falls back to.