Skip to main content

ModelRuntime

Trait ModelRuntime 

Source
pub trait ModelRuntime: Send + Sync {
    // Required method
    fn load(&self, model: &CatalogModel) -> Result<Arc<dyn LoadedModel>>;

    // Provided method
    fn can_load(&self, _model: &CatalogModel) -> bool { ... }
}
Expand description

Loads catalogue models into memory. Freed by dropping the result.

Required Methods§

Source

fn load(&self, model: &CatalogModel) -> Result<Arc<dyn LoadedModel>>

Provided Methods§

Source

fn can_load(&self, _model: &CatalogModel) -> bool

Whether this runtime has an in-process loader for model’s engine; the tray UI offers Load only when it does.

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§