Struct Quantizer7Bit 

pub struct Quantizer7Bit {
    pub scales: Vec<f32>,
    pub block_size: usize,
}

7-bit quantizer for reasoning

Uses signed int8 container with values in -64..63. Stable accumulators, close to int8 quality.

Fields

scales: Vec<f32>

Per-block scale factors

block_size: usize

Block size

Implementations

impl Quantizer7Bit

pub fn new(block_size: usize) -> Self

Create a new 7-bit quantizer

pub fn quantize(&mut self, values: &[f32]) -> Vec<i8>

Quantize f32 values to 7-bit (stored in int8)

pub fn dequantize(&self, data: &[i8]) -> Vec<f32>

Dequantize 7-bit values to f32

pub fn apply_lora_delta( &mut self, base: &[i8], delta: &[i8], alpha: f32, ) -> Vec<i8>

Apply micro-LoRA delta (in 7-bit precision)

Trait Implementations

impl Clone for Quantizer7Bit

fn clone(&self) -> Quantizer7Bit

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Quantizer7Bit

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.