Skip to main content

Module runtime

Module runtime 

Source
Expand description

Runtime / transport / provider taxonomy and per-runtime configuration.

Doc references: §3.1 (backend taxonomy), §5.4 (TransportKind / ProviderKind enums), §10.5 (feature flags).

Structs§

CircuitBreakerConfig
Circuit-breaker config (doc §3.5, §12.2). One per (provider, endpoint); opens after sustained failures, half-opens after the configured duration to permit a probe.

Enums§

JitterKind
ProviderKind
RuntimeConfig
Per-deployment runtime configuration. The runtime discriminator drives both the backend selection and the shape of the inner config blob. Per-runtime crates each contribute one variant or expose their own RuntimeConfig-shaped struct that can be wrapped in Custom.
RuntimeKind
Identifies the runtime backend that hosts a model.
TransportKind
Where the runtime executes — local GPU vs remote network. Read by PlacementActor and the worker-spawning logic to decide what kind of WorkerActor to spin up. Doc §5.4.