Expand description
Symmetric quantization: one scale per group, codes centered on zero.
Functionsยง
- quantize
- Quantize
valuesinto fixed-size blocks ofBLOCKwithBITS-wide codes. - quantize_
tensor - Quantize the entire tensor with a single scale.
- quantize_
with - Runtime-width variant of
quantize.