Struct InstancePoolConfig 

#[non_exhaustive]
pub struct InstancePoolConfig {
    pub warm_instances_per_tuple: usize,
    pub max_total_warm: usize,
}

Pool configuration. One pool per executor.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

warm_instances_per_tuple: usize

Pre-spawn N instances per (tenant, module-hash) tuple. Default 0 = pool disabled (every acquire falls through to TensorWasmExecutor::spawn_instance).

The pool’s channel capacity is max(warm_instances_per_tuple, 1) — a rendezvous channel (capacity 0) would deadlock the release path, so we floor the channel size at 1 even when pre-warming is disabled. With a 0 setting the warm channel is empty at startup and the first release populates it; this gives the second acquire of the same tuple a warm draw at the cost of paying cold-start on the first.

max_total_warm: usize

Maximum number of pre-spawned instances across all tuples. Pools honour this cap before spawning a new tuple. Default 0 = unlimited (within the executor’s max_instances).

Implementations

impl InstancePoolConfig

pub fn new(warm_instances_per_tuple: usize, max_total_warm: usize) -> Self

Construct a pool config. Kept available for foreign-crate callers even though InstancePoolConfig is #[non_exhaustive].

Trait Implementations

impl Clone for InstancePoolConfig

fn clone(&self) -> InstancePoolConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InstancePoolConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for InstancePoolConfig

fn default() -> InstancePoolConfig

Returns the “default value” for a type.