Module quantize 

Quantization Functions

Functions for quantizing tensors to various formats.

@version 0.1.0 @author AutomataNexus Development Team

Structs

QuantizationStats

Returns statistics about quantization error.

Functions

compute_quantization_error

Computes the quantization error (RMSE) between original and quantized.

compute_quantization_stats

Computes detailed quantization statistics.

quantize_model

Quantizes a model (collection of named tensors).

quantize_tensor

Quantizes a tensor to the specified quantization type.