Function quantize_tensor 

pub fn quantize_tensor(
    values: &[f32],
    shape: &[usize],
    granularity: QuantGranularity,
    mode: QuantMode,
    bits: u8,
) -> QuantizedTensor

Quantize tensor with specified granularity

Arguments

• values - Input tensor values
• shape - Tensor shape
• granularity - Quantization granularity
• mode - Quantization mode
• bits - Bit width (4 or 8)