Expand description
Runtime / transport / provider taxonomy and per-runtime configuration.
Doc references: §3.1 (backend taxonomy), §5.4 (TransportKind /
ProviderKind enums), §10.5 (feature flags).
Structs§
- Circuit
Breaker Config - Circuit-breaker config (doc §3.5, §12.2). One per
(provider, endpoint); opens after sustained failures, half-opens after the configured duration to permit a probe.
Enums§
- Jitter
Kind - Provider
Kind - Runtime
Config - Per-deployment runtime configuration. The
runtimediscriminator drives both the backend selection and the shape of the inner config blob. Per-runtime crates each contribute one variant or expose their ownRuntimeConfig-shaped struct that can be wrapped inCustom. - Runtime
Kind - Identifies the runtime backend that hosts a model.
- Transport
Kind - Where the runtime executes — local GPU vs remote network. Read by
PlacementActorand the worker-spawning logic to decide what kind ofWorkerActorto spin up. Doc §5.4.