Struct Deployment 

pub struct Deployment {
    pub name: String,
    pub model: String,
    pub runtime: Option<RuntimeKind>,
    pub runtime_config: Option<RuntimeConfig>,
    pub gpus: Option<u32>,
    pub replicas: u32,
    pub serving: Serving,
    pub budget: Option<Budget>,
    pub idempotent: bool,
}

A model deployment. The runtime field selects the backend; every other field has a runtime-agnostic interpretation. Local deployments fill gpus; remote deployments leave it None and use serving’s max_concurrent instead.

Fields

name: String

model: String

runtime: Option<RuntimeKind>

Optional explicit runtime. When omitted, infer_runtime picks based on the model name (doc §3.2).

runtime_config: Option<RuntimeConfig>

Backend-specific configuration. When omitted, defaults are used.

gpus: Option<u32>

Local-only: number of GPUs per replica.

replicas: u32

Number of replicas (local: HA + scale-out; remote: independent worker pools, possibly different API keys).

serving: Serving

budget: Option<Budget>

idempotent: bool

True for normal LLM inference; false to disable retries on non-idempotent stateful APIs (doc §12.3).

Implementations

impl Deployment

pub fn effective_runtime(&self) -> RuntimeKind

Effective runtime kind: explicit override wins, otherwise infer from the model name (doc §3.2).

pub fn validate(&self) -> Result<(), DeploymentValidationError>

Cheap structural validation done at deploy time. Heavier checks (provider tier limits, network egress) live in inference-runtime where we can perform IO.

Trait Implementations

impl Clone for Deployment

fn clone(&self) -> Deployment

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Deployment

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Deployment

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for Deployment

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.