Struct ResidencyLedger 

pub struct ResidencyLedger { /* private fields */ }

The node’s resident instances.

Implementations

impl ResidencyLedger

pub fn new(budget_bytes: Option<u64>) -> Self

A ledger with budget_bytes of unified memory (None: only exclusions are checked).

pub fn budget(&self) -> Option<u64>

The budget, if any.

pub fn reserve( &self, instance: &str, spec: &InferenceSpec, ) -> Result<bool, CoResidency>

Reserve spec’s memory for instance. Ok(true) when newly reserved, Ok(false) when this instance already held it.

pub fn release(&self, instance: &str)

Release what instance held (no-op if nothing).

pub fn used(&self) -> u64

Bytes reserved.

pub fn snapshot(&self) -> Vec<(String, u64)>

Resident roles and their bytes.