Skip to main content

quantize_int4

Function quantize_int4 

Source
pub fn quantize_int4(data: &[f32], params: &QuantParams) -> Vec<u8> 
Expand description

Quantize an f32 tensor to INT4 (packed, 2 values per byte).