Struct LanguageModelPrefixLoader 

pub struct LanguageModelPrefixLoader<'a> { /* private fields */ }

Maps Llama-shaped keys (model.*, lm_head.*) to Voxtral safetensor names.

Implementations

impl<'a> LanguageModelPrefixLoader<'a>

pub fn new(inner: &'a mut WeightMap) -> LanguageModelPrefixLoader<'a>

Trait Implementations

impl WeightLoader for LanguageModelPrefixLoader<'_>

fn len(&self) -> usize

Number of distinct weights in the file.

fn take(&mut self, key: &str) -> Result<(Vec<f32>, Vec<usize>), Error>

Take the named tensor as (f32_data, shape). Removes from the loader so callers can detect “weights I never used.”

fn take_transposed( &mut self, key: &str, ) -> Result<(Vec<f32>, Vec<usize>), Error>

Same as take but transposed (last two dims swapped). Most safetensors weights are stored row-major-of-PyTorch convention, which RLX’s IR consumes column-major; this helper is the convention-bridge.

fn remaining_keys(&self) -> Vec<String>

Names that haven’t been taken yet — useful for “did the model use every weight?” hygiene checks.

fn format_id(&self) -> &'static str

Format id (safetensors, gguf, or a custom registration).

fn is_empty(&self) -> bool

fn take_packed( &mut self, key: &str, ) -> Result<Option<(Vec<u8>, QuantScheme, Vec<usize>)>, Error>

Take packed K-quant bytes when supported; default returns None.

fn tensor_bytes_borrowed(&self, key: &str) -> Option<&[u8]>

Borrow packed bytes without marking taken (GGUF mmap path).

fn arch_hint(&self) -> Option<&str>

Architecture name from the underlying file (general.architecture for GGUF, None for safetensors). Drain-style consumers use this to pick an arch-specific reverse name mapping when the canonical HF name depends on the model family (e.g. Gemma 2’s 4 norms per layer don’t share the Llama 2-norm reverse alias).