Skip to main content

quantized_matmul

Function quantized_matmul 

Source
pub fn quantized_matmul(
    x: &Array,
    w: &Array,
    scales: &Array,
    biases: &Array,
    transpose: bool,
    group_size: i32,
    bits: i32,
) -> Array
Expand description

x · dequantize(w)ᵀ (or without the transpose); see Array::quantized_matmul.