Skip to main content

Module quantize

Module quantize 

Source

Structs§

PerLayerQuant
The result of quantizing one weight tensor.

Functions§

quantize_layers
Single-threaded fallback.
quantize_layers_parallel
Quantize all layers of a model in parallel (requires parallel feature).