Struct QuantFormat 

pub struct QuantFormat {
    pub name: &'static str,
    pub block_size: usize,
    pub block_bytes: usize,
    pub ggml_type_id: u32,
}

Quantization format descriptor with block geometry.

Each format defines a fixed relationship between element count and byte size. Kernels use these to compute buffer sizes and validate inputs.

Fields

name: &'static str

Human-readable name (e.g., “Q4_K”)

block_size: usize

Elements per quantization block

block_bytes: usize

Bytes per quantization block

ggml_type_id: u32

GGML type ID (for GGUF interop)

Implementations

impl QuantFormat

pub const fn expected_bytes(&self, rows: usize, cols: usize) -> usize

Compute the expected byte size for a weight matrix [rows, cols].

The matrix is stored as rows independent row vectors, each quantized into ceil(cols / block_size) blocks of block_bytes bytes.

Row-Major Contract

For GEMV y = W·x where W is [out_dim, in_dim]:

• rows = out_dim (number of output features)
• cols = in_dim (number of input features, quantized along this axis)

pub fn validate_buffer( &self, weight_name: &str, actual_bytes: usize, rows: usize, cols: usize, ) -> Result<(), WeightBufferError>

Validate that a weight buffer has the correct size for [rows, cols].

Errors

Returns WeightBufferError if actual_bytes does not match the expected size for the given dimensions and quantization format.

Trait Implementations

impl Clone for QuantFormat

fn clone(&self) -> QuantFormat

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QuantFormat

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for QuantFormat

fn eq(&self, other: &QuantFormat) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for QuantFormat

impl Eq for QuantFormat

impl StructuralPartialEq for QuantFormat