pub fn quantize(
w: &Array,
group_size: usize,
bits: u32,
) -> Result<(Array, Array, Array)>Expand description
Quantizes the last axis of w (float16, bfloat16 or float32, at least 2-D, the last
dimension divisible by group_size) in groups of group_size (32, 64 or 128) values with
bits (1–6 or 8) bits each. Returns the packed codes (uint32, last dimension
· bits / 32), the scales and the biases (w’s dtype, last dimension / group_size),
equal to MLX’s bit for bit.