Skip to main content

dequantize_int4

cuda_rust_wasm::runtime::quantization

Function dequantize_int4 

Source 
pub fn dequantize_int4(
    data: &[u8],
    count: usize,
    params: &QuantParams,
) -> Vec<f32>
Expand description

Dequantize INT4 (packed) to f32.