Skip to main content

dequant_q2_k

Function dequant_q2_k 

Source
pub fn dequant_q2_k(src: &[u8]) -> Result<Vec<f32>, QuantError>
Expand description

Dequantize a Q2_K buffer into f32. Formula verified against real ggml-quants.c::dequantize_row_q2_K: 16 sub-blocks of 16 elements, each sub-block’s (scale, min) packed one byte per sub-block (sc & 0xF = 4-bit scale, sc >> 4 = 4-bit min – much simpler than Q4_K’s cross-byte 6-bit packing), value = d*scale*raw2bit - dmin*min, raw2bit in 0..=3 (2 bits per element from qs, 4 elements packed per byte).