Struct ModelManager 

pub struct ModelManager { /* private fields */ }

Thread-safe model session manager with caching and hot-swap support.

Manages the lifecycle of ONNX models used for embedding generation, including loading, caching, and version management.

Implementations

impl ModelManager

pub fn new(config: ModelConfig) -> Result<Self, ModelError>

Create a new model manager with the given configuration.

Errors

Returns an error if the model directory doesn’t exist and can’t be created.

pub fn with_defaults() -> Result<Self, ModelError>

Create with default configuration

pub fn load_model(&self, name: &str) -> Result<Arc<OnnxInference>, ModelError>

Load a model from a file.

Arguments

• name - Model name (e.g., “perch-v2”)

Errors

Returns an error if the model file doesn’t exist or fails to load.

pub fn verify_checksum( &self, path: &Path, expected: &str, ) -> Result<bool, ModelError>

Verify the checksum of a model file.

Errors

Returns an error if the checksum doesn’t match.

pub fn hot_swap(&self, name: &str, new_path: &Path) -> Result<(), ModelError>

Hot-swap to a new model version without restart.

Arguments

• name - Model name
• new_path - Path to the new model file

Errors

Returns an error if the new model fails to load.

pub async fn get_inference(&self) -> Result<Arc<OnnxInference>, ModelError>

Get the ONNX inference engine for the current model.

Errors

Returns an error if no model is loaded.

pub fn current_version(&self) -> ModelVersion

Get the currently active model version.

pub fn set_active_version(&self, version: ModelVersion)

Set the active model version.

pub async fn is_ready(&self) -> bool

Check if a model is loaded and ready.

pub fn get_model(&self, version_key: &str) -> Option<EmbeddingModel>

Get model metadata for a version.

pub fn list_models(&self) -> Vec<EmbeddingModel>

List all loaded models.

pub fn clear_cache(&self)

Clear all cached sessions.

pub fn register_model(&self, model: EmbeddingModel)

Register a model without loading it.

pub fn unload_model(&self, version_key: &str) -> bool

Unload a specific model version from cache.

Trait Implementations

impl Debug for ModelManager

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.