Struct ModelRegistry 

pub struct ModelRegistry<T> { /* private fields */ }

Shared resident model registry with weighted LRU eviction.

Implementations

impl<T> ModelRegistry<T>

pub fn new(config: RegistryConfig) -> Self

pub fn config(&self) -> &RegistryConfig

pub fn total_weight(&self) -> u64

pub fn len(&self) -> usize

pub fn is_empty(&self) -> bool

pub fn insert( &self, key: LoadKey, value: Arc<T>, weight: ResidencyWeight, ) -> Result<Arc<RegistryEntry<T>>>

Insert or refresh an entry. Evicts idle entries if needed.

New inserts start with active_refs == 0. Prefer Self::insert_and_pin when the caller will immediately use the value (JOE-1646).

pub fn insert_and_pin( &self, key: LoadKey, value: Arc<T>, weight: ResidencyWeight, ) -> Result<RegistryPin<T>>

Insert (or refresh) and return a pin under one lock — no eviction window between publication and active lease (JOE-1646).

pub fn get(&self, key: &LoadKey) -> Option<Arc<RegistryEntry<T>>>

pub fn pin(&self, key: &LoadKey) -> Option<RegistryPin<T>>

Pin for an active operation (prevents eviction).

Prefer Self::get_and_pin when the caller needs the value only while pinned (atomic lookup+lease).

pub fn get_and_pin(&self, key: &LoadKey) -> Option<RegistryPin<T>>

Atomic lookup + pin under the registry lock (JOE-1646).

There is no window where the entry can be evicted after the caller has observed it but before active_refs is incremented.

pub fn clear_idle(&self) -> (usize, usize)

Drop idle entries only (JOE-1646 third-pass).

Entries with active_refs > 0 or pinned stay in the map with their weight so residency accounting remains truthful and a same-key reload cannot multiply native sessions while an operation still holds a pin.

Returns (removed, retained_active).

pub fn clear(&self)

Alias for Self::clear_idle — never forcibly drops active leases.

pub fn try_unload(&self, key: &LoadKey) -> bool

Remove a specific key if not active.

pub fn snapshot(&self) -> Vec<RegistrySnapshot>