Skip to main content

Module inference

Module inference 

Source
Expand description

Inference — model inference and serving utilities

Provides inference endpoints isolated from training loops to prevent hidden feedback loops (MTD-09: Feedback Loop Detection).

Training and inference are strictly separated:

  • Training reads from data, writes model weights
  • Inference reads model weights, serves predictions
  • No inference output feeds back into training data

Structs§

InferenceConfig
Inference configuration