Crate quantize 

quantize

A tiny, readable quantization library — block-wise symmetric, any bit width.

Example

use quantize::{quantize, dequantize};

let weights = [0.42_f32, -0.10, 0.70, -0.50];

// 8-bit, block-size-32, f32 scales
let (scales, codes) = quantize::<f32, 8, 32>(&weights);
let back = dequantize::<_, 32>(&scales, &codes);

assert!((back[0] - weights[0]).abs() < 0.01);

BITS and BLOCK are const generics, so quantize::<4, 32>(...), quantize::<8, 64>(...), etc. all compile to specialized code with zero runtime overhead.

Re-exports

pub use block::dequantize;

pub use block::quantize;

pub use scale::Scale;

Modules

block

Block quantization, any bit width and scale precision.

scale

Scale trait — defines how per-block scale factors are stored.