Expand description
Quantization configuration parsed from model metadata.
Populated by WeightLoader implementations from sources like
quantize_config.json (GPTQ/AWQ) or a GGUF header.
Structs§
- Quant
Config - Combined quantization config.
Enums§
- Quant
Method - The quantization scheme in use, if any.