Expand description
Types representing the quantization scheme
Structs§
- Block
Scale - The per-block scale level of a
QuantScheme: one scale per block of values. - Block
Size - Copyable block size, specialized version of
SmallVec. - F32Grid
- A narrower float format’s grid, laid over the f32 bit pattern.
- Quant
Scheme - Describes a quantization scheme/configuration.
- Subnormal
Range - Where a format’s subnormals begin and how far apart they are, in f32.
Enums§
- Quant
Mode - Strategy used to quantize values.
- Quant
Store - Data type used to stored quantized values.
- Quant
Value - Data type used to represent quantized values.
- Scale
Dtype - The data type a scale level stores its scales in.