Skip to main content

vec_dot_q8_0

Function vec_dot_q8_0 

Source
pub fn vec_dot_q8_0(w_bytes: &[u8], x: &[f32]) -> f32
Expand description

Computes the dot product between a Q8_0 quantized weight row and an FP32 vector directly without full dequantization.