Struct InferConfig 

pub struct InferConfig {
    pub flavor: InferFlavor,
    pub mode: InferMode,
    pub probe_timeout: Duration,
    pub probe_port: Option<u16>,
    pub allowed_ports: Option<(u16, u16)>,
    pub deep_timeout: Duration,
}

One adapter’s configuration.

Fields

flavor: InferFlavor

Server software.

mode: InferMode

Adopted or managed.

probe_timeout: Duration

Per-request timeout of probes.

probe_port: Option<u16>

Port the capability probe asks (the flavor’s conventional port when absent). Instances carry their own ports.

allowed_ports: Option<(u16, u16)>

Inclusive port range instances may use. Checked before anything is probed: a spec naming a port outside it never causes a connection.

deep_timeout: Duration

Timeout of InferRuntime::deep_health (a cold model can take minutes to answer its first token).

Implementations

impl InferConfig

pub fn with_port_range(self, lo: u16, hi: u16) -> Self

Limit instances to ports in lo..=hi.

pub fn with_probe_port(self, port: u16) -> Self

Probe a different port for capabilities.

pub fn adopted(flavor: InferFlavor) -> Self

An adopting adapter.

pub fn managed(flavor: InferFlavor, cfg: ManagedConfig) -> Self

A managing adapter.

Trait Implementations

impl Clone for InferConfig

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.