Module quantization 

Tensor quantization module.

Structs

BlockSize

Copyable block size, specialized version of SmallVec.

CalibrationRange

The observed input calibration range.

QParamTensor

A quantization parameter tensor descriptor.

QParams

The quantization tensor data parameters.

QuantConfig

Configuration for a device quantization behavior.

QuantScheme

Describes a quantization scheme/configuration.

QuantizedBytes

Quantized data bytes representation.

Enums

Calibration

Calibration method used to compute the quantization range mapping.

QuantAcc

The precision of accumulating elements.

QuantLevel

Level or granularity of quantization.

QuantMode

Strategy used to quantize values.

QuantParam

Quantization floating-point precision.

QuantPropagation

Specify if the output of an operation is quantized using the scheme of the input or returned unquantized.

QuantStore

Data type used to stored quantized values.

QuantValue

Data type used to represent quantized values.

Constants

QPARAM_ALIGN

Alignment (in bytes) for quantization parameters in serialized tensor data.

Functions

compute_q_params

Compute the quantization parameters.

compute_range

Compute the quantization range mapping.

pack_i8s_to_u32s

Pack signed 8-bit integer values into a sequence of unsigned 32-bit integers.

params_shape

Calculate the shape of the quantization parameters for a given tensor and level

Type Aliases

QuantizationParameters

The tensor quantization parameters.