Skip to main content

analyze_error

entrenar::quant

Function analyze_error 

Source 
pub fn analyze_error(
    original: &[f32],
    params: &QuantParams,
    outlier_threshold: f32,
) -> QuantErrorStats
Expand description

Analyze quantization error for given values and parameters

ยงArguments

  • original - Original f32 values
  • params - Quantization parameters
  • outlier_threshold - Error threshold for outlier detection