Module quantization

Module quantization 

Source
Expand description

Quantization techniques for memory compression

Structs§

BinaryQuantized
Binary quantization (32x compression)
ProductQuantized
Product quantization (8-16x compression)
ScalarQuantized
Scalar quantization to int8 (4x compression)

Traits§

QuantizedVector
Trait for quantized vector representations