polarquant 0.1.0

Rust implementation for Walsh-Hadamard rotation + polar coordinate quantization for LLM weight and KV cache compression
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16

//! # PolarQuant
//!
//! Walsh-Hadamard rotation + polar coordinate quantization for LLM weight and KV cache compression.
//!
//! ## Overview
//! PolarQuant compresses neural network weights and KV cache embeddings by:
//! 1. Block-wise L2 normalization to the unit hypersphere
//! 2. Walsh-Hadamard rotation to decorrelate values into approximately i.i.d. Gaussian
//! 3. Recursive polar coordinate transformation
//! 4. Lloyd-Max optimal codebook quantization of resulting angles
//!
//! Work in progress. Contributions welcome.

pub fn placeholder() {
    todo!("Implementation coming soon")
}