Skip to main content

quantize_q4_k_matrix

Function quantize_q4_k_matrix 

Source
pub fn quantize_q4_k_matrix(data: &[f32], shape: &[usize]) -> Vec<u8> 
Expand description

Quantize F32 matrix to Q4_K format with proper row layout

Processes each row independently to maintain row-major layout.