Skip to main content

compute_scales

Function compute_scales 

Source
pub fn compute_scales(frame: &[f32], group_len: usize, bits: u8) -> Vec<u16>
Expand description

Compute f16 group scales for a frame.

Returns one f16-encoded scale per group of group_len elements. Each scale is max(|v|) / qmax for that group, stored as IEEE 754 half-precision.