Skip to main content

Module value_objects

Module value_objects 

Source
Expand description

Core value objects from the ubiquitous language.

Enums§

DeviceTarget
Requested device class; Auto is resolved by the Hardware & Delegate context at runtime.
ModelFormat
Supported on-disk model formats (ADR-002). .pte/GGUF-via-C++ is gone; Candle reads GGUF and safetensors natively, ONNX via tract.
Phase
Inference session state machine (ADR-001).
RuntimeKind
The execution engine that owns a loaded model (ADR-002).
SafetyMode
Tiered safety strategy (ADR-005), budget-gated by device profile.
SpeculationMode
Speculative decoding strategy (ADR-002 / context 3). Default is Off.
StopReason
Why generation stopped.

Type Aliases§

Token
A vocabulary id produced or consumed by the model — the atomic generation unit.