Struct ResidentTensor 

pub struct ResidentTensor {
    pub data: Arc<[u8]>,
    pub size_bytes: usize,
}

A tensor that is currently resident in RAM.

The bytes are stored as a reference-counted slice. The dequantization step happens outside the pager — callers pass data directly to the fused GEMM kernels (or dequant on-the-fly as in the existing arch layer).

Fields

data: Arc<[u8]>

Raw quantized bytes from the GGUF weight store.

size_bytes: usize

Byte length of data (cached to avoid the indirection).

Trait Implementations

impl Debug for ResidentTensor

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.