Struct ModelLoader 

pub struct ModelLoader {
    pub default_context_size: Option<usize>,
    pub default_num_threads: usize,
    /* private fields */
}

A registry that maps model IDs to filesystem specs.

Used by ModelPool::acquire to locate models it has not yet loaded.

Fields

default_context_size: Option<usize>

Default context size to pass to the engine.

default_num_threads: usize

Default thread count.

Implementations

impl ModelLoader

pub fn new() -> Self

Create a new loader with no registered models.

pub fn register(&mut self, id: impl Into<String>, spec: ModelSpec)

Register a model ID → spec mapping so the pool can load it on demand.

pub fn lookup(&self, id: &str) -> Option<&ModelSpec>

Look up the spec for a model ID.

pub fn build_engine_config(&self, id: &str, spec: &ModelSpec) -> EngineConfig

Build an EngineConfig for the given model spec.

Trait Implementations

impl Default for ModelLoader

fn default() -> Self

Returns the “default value” for a type.