Skip to main content

Module quantization

Module quantization 

Source
Expand description

Quantization techniques for memory compression

Enums§

QuantizedVector
Quantized vector representation

Functions§

calculate_compression_ratio
Calculate memory savings from quantization
dequantize
Dequantize a quantized vector back to float32
quantize
Quantize a vector using specified quantization type