Enum QuantizationArguments 

pub enum QuantizationArguments<'a> {
    ScaleZeroPointDataType {
        scale: f64,
        zero_point: i64,
        data_type: DataType,
    },
    ScaleTensorZeroPointDataTypeAxis {
        scale_tensor: &'a Tensor,
        zero_point: f64,
        data_type: DataType,
        axis: i64,
    },
    ScaleTensorZeroPointTensorDataTypeAxis {
        scale_tensor: &'a Tensor,
        zero_point_tensor: &'a Tensor,
        data_type: DataType,
        axis: i64,
    },
}

Arguments controlling how a floating-point tensor is quantized into an integer representation.

All variants follow the same conceptual formula but differ in whether the scale and zero-point are provided as scalars or tensors and whether the scaling is applied per-axis.

Variants

ScaleZeroPointDataType

Quantize using scalar scale / zero_point.

Details

Formula: result = (tensor / scale) + zero_point.

Fields

scale: f64

Scale scalar parameter

zero_point: i64

Bias scalar parameter (converted to dataType of resultTensor)

data_type: DataType

Integer data type of the result tensor.

ScaleTensorZeroPointDataTypeAxis

Quantize using a per-axis scale_tensor and scalar zero_point.

Details

Formula: result = (tensor / scale_tensor) + zero_point.

Fields

scale_tensor: &'a Tensor

Scale 1D Tensor parameter with size == tensor.shape[axis]

zero_point: f64

Bias scalar parameter (converted to dataType of resultTensor)

data_type: DataType

Integer data type of the result tensor.

axis: i64

Axis on which the scale 1D value is being broadcasted

ScaleTensorZeroPointTensorDataTypeAxis

Quantize using per-axis scale_tensor and zero_point_tensor.

Details

Formula: result = (tensor / scale_tensor) + zero_point_tensor.

Fields

scale_tensor: &'a Tensor

Scale scalar or 1D Tensor parameter with size == tensor.shape[axis]

zero_point_tensor: &'a Tensor

Bias scalar or 1D Tensor parameter with size == tensor.shape[axis]

data_type: DataType

Integer data type of the result tensor.

axis: i64

Axis on which the scale 1D value is being broadcasted