Skip to main content

dequant_q4_0

Function dequant_q4_0 

Source
pub fn dequant_q4_0(src: &[u8]) -> Result<Vec<f32>, QuantError>
Expand description

Dequantize a Q4_0 buffer into f32. Each byte packs two 4-bit nibbles (low nibble = element i, high nibble = element i+16), each nibble biased by -8 before scaling, matching the public Q4_0 convention.