Skip to main content

quantize_q5_k_matrix

Function quantize_q5_k_matrix 

Source
pub fn quantize_q5_k_matrix(data: &[f32], shape: &[usize]) -> Vec<u8> 
Expand description

Quantize F32 matrix to Q5_K format with proper row layout