Skip to main content

dequant_q5_0

Function dequant_q5_0 

Source
pub fn dequant_q5_0(src: &[u8]) -> Result<Vec<f32>, QuantError>
Expand description

Dequantize a Q5_0 buffer into f32. Formula verified against real ggml-quants.c::dequantize_row_q5_0: symmetric, y = (q-16)*d where q is the 4-bit nibble with the 5th bit from qh ORed in.