Struct ArcCacheLoader 

pub struct ArcCacheLoader<'a> { /* private fields */ }

WeightLoader view over a frozen HashMap of ArcF32Tensor. Graph builders take tensors out of this view (one Vec copy per weight into compile params) without cloning the entire cache first.

Implementations

impl<'a> ArcCacheLoader<'a>

pub fn new( cache: &'a HashMap<String, (Arc<Vec<f32>>, Vec<usize>)>, ) -> ArcCacheLoader<'a>

Trait Implementations

impl WeightLoader for ArcCacheLoader<'_>

fn format_id(&self) -> &'static str

Format id (safetensors, gguf, or a custom registration).

fn len(&self) -> usize

Number of distinct weights in the file.

fn take(&mut self, key: &str) -> Result<(Vec<f32>, Vec<usize>), Error>

Take the named tensor as (f32_data, shape). Removes from the loader so callers can detect “weights I never used.”

fn take_transposed( &mut self, key: &str, ) -> Result<(Vec<f32>, Vec<usize>), Error>

Same as take but transposed (last two dims swapped). Most safetensors weights are stored row-major-of-PyTorch convention, which RLX’s IR consumes column-major; this helper is the convention-bridge.

fn remaining_keys(&self) -> Vec<String>

Names that haven’t been taken yet — useful for “did the model use every weight?” hygiene checks.

fn is_empty(&self) -> bool

fn take_packed( &mut self, key: &str, ) -> Result<Option<(Vec<u8>, QuantScheme, Vec<usize>)>, Error>

Take packed K-quant bytes when supported; default returns None.

fn tensor_bytes_borrowed(&self, key: &str) -> Option<&[u8]>

Borrow packed bytes without marking taken (GGUF mmap path).

fn arch_hint(&self) -> Option<&str>

Architecture name from the underlying file (general.architecture for GGUF, None for safetensors). Drain-style consumers use this to pick an arch-specific reverse name mapping when the canonical HF name depends on the model family (e.g. Gemma 2’s 4 norms per layer don’t share the Llama 2-norm reverse alias).