Struct ModelLoader 

pub struct ModelLoader { /* private fields */ }

Model loader for GGUF files

Implementations

impl ModelLoader

pub fn load<P: AsRef<Path>>(path: P) -> ModelResult<Self>

Load a model from a GGUF file path

pub fn config(&self) -> &ModelConfig

Get the model configuration

pub fn config_mut(&mut self) -> &mut ModelConfig

Get mutable reference to model configuration (e.g., to clamp context length).

pub fn architecture(&self) -> Architecture

Get the detected architecture

pub fn build_model(self) -> ModelResult<LlamaModel>

Build the model from loaded weights.

Delegates to the format-independent build_llama_model free function via the ModelSource trait, so that SafeTensors and other loaders can reuse the same layer assembly logic.

pub fn build_bert_model(self) -> ModelResult<BertModel>

Build a BERT encoder-only model from loaded weights

pub fn deltanet_config(&self) -> Option<DeltaNetConfig>

Get the DeltaNet config for creating recurrent state (Qwen3Next). Returns None if the model has no SSM layers or is Mamba.

pub fn recurrent_config(&self) -> Option<RecurrentConfig>

Get the recurrent config (DeltaNet or Mamba) for creating inference context.

Trait Implementations

impl ModelSource for ModelLoader

fn config(&self) -> &ModelConfig

Get parsed model configuration.

fn config_mut(&mut self) -> &mut ModelConfig

Get mutable reference to model configuration.

fn architecture(&self) -> Architecture

Get detected architecture.

fn load_tensor(&self, name: &str) -> ModelResult<Tensor>

Load a tensor by internal name (e.g., “blk.0.attn_q.weight”).

fn try_load_tensor(&self, name: &str) -> Option<Tensor>

Try to load a tensor (None if not found).