Enum RuntimeConfig 

pub enum RuntimeConfig {
    Vllm(Value),
    TensorRt(Value),
    Ort(Value),
    Candle(Value),
    Cudarc(Value),
    MistralRs(Value),
    OpenAi(Value),
    Anthropic(Value),
    Gemini(Value),
    LiteLlm(Value),
    Custom {
        kind: String,
        config: Value,
    },
}

Per-deployment runtime configuration. The runtime discriminator drives both the backend selection and the shape of the inner config blob. Per-runtime crates each contribute one variant or expose their own RuntimeConfig-shaped struct that can be wrapped in Custom.

Variants

Vllm(Value)

vLLM (local Python). Body intentionally opaque here — the real shape lives in inference-runtime-vllm and is parsed lazily.

TensorRt(Value)

Ort(Value)

Candle(Value)

Cudarc(Value)

MistralRs(Value)

OpenAi(Value)

Remote OpenAI / Azure OpenAI. Concrete shape in inference-runtime-openai::OpenAiConfig.

Anthropic(Value)

Gemini(Value)

LiteLlm(Value)

Custom

Custom backend (third-party runtime crate).

Fields

kind: String

config: Value

Implementations

impl RuntimeConfig

pub fn runtime_kind(&self) -> RuntimeKind

pub fn transport_kind(&self) -> TransportKind

Trait Implementations

impl Clone for RuntimeConfig

fn clone(&self) -> RuntimeConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RuntimeConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for RuntimeConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for RuntimeConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.