Skip to main content

dequant_q5_k

Function dequant_q5_k 

Source
pub fn dequant_q5_k(src: &[u8]) -> Result<Vec<f32>, QuantError>
Expand description

Dequantize a Q5_K buffer into f32. See the module doc comment and Q5_K_BLOCK_BYTES for the block layout. Shares Q4_K’s scale/min packing (q4_k_scale_min) and 4-outer-iteration structure; the only difference is each nibble gets a 5th bit from qh, whose 32 bytes are reused across all 4 outer iterations at different bit positions (u1/u2, doubling by 4 each iteration) rather than being consumed sequentially the way qs is.