Struct Quantizer5Bit 

pub struct Quantizer5Bit {
    pub scales: Vec<f32>,
    pub block_size: usize,
    pub per_channel: bool,
}

5-bit quantizer for streaming embeddings

Uses signed int8 container with values in -16..15. Per-channel or per-block scale for stable streaming updates.

Fields

scales: Vec<f32>

Per-block scale factors

block_size: usize

Block size

per_channel: bool

Use per-channel scaling (instead of per-block)

Implementations

impl Quantizer5Bit

pub fn new(block_size: usize) -> Self

Create a new 5-bit quantizer

pub fn with_per_channel(self) -> Self

Enable per-channel scaling

pub fn quantize(&mut self, values: &[f32]) -> Vec<i8>

Quantize f32 values to 5-bit (stored in int8)

pub fn dequantize(&self, data: &[i8]) -> Vec<f32>

Dequantize 5-bit values to f32

Trait Implementations

impl Clone for Quantizer5Bit

fn clone(&self) -> Quantizer5Bit

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Quantizer5Bit

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.