Skip to main content

quantize_batch_consistent

Function quantize_batch_consistent 

Source
pub fn quantize_batch_consistent(
    tensors: &[&Tensor],
    config: &QuantConfig,
) -> Result<Vec<(Tensor, f32, i32)>>
Expand description

Batch quantization utility for multiple tensors with consistent parameters

Quantizes multiple tensors using globally consistent parameters calculated across all tensors. This ensures that all tensors use the same scale and zero point for consistent quantization.

§Arguments

  • tensors - Slice of tensor references to quantize
  • config - Quantization configuration to use

§Returns

Vector of quantized tensors with their scale and zero point parameters