Skip to main content

vec_dot_q4_0

Function vec_dot_q4_0 

Source
pub fn vec_dot_q4_0(w_bytes: &[u8], x: &[f32]) -> f32
Expand description

Computes the dot product between a Q4_0 quantized weight row and an FP32 vector directly without full dequantization.