Expand description
Inference — model inference and serving utilities
Provides inference endpoints isolated from training loops to prevent hidden feedback loops (MTD-09: Feedback Loop Detection).
Training and inference are strictly separated:
- Training reads from data, writes model weights
- Inference reads model weights, serves predictions
- No inference output feeds back into training data
Structs§
- Inference
Config - Inference configuration