Struct QuantWeights 

pub struct QuantWeights<'a, B: Backend> {
    pub qweight: &'a B::Buffer,
    pub scales: Option<&'a B::Buffer>,
    pub zeros: Option<&'a B::Buffer>,
    pub g_idx: Option<&'a B::Buffer>,
}

Packed quantized weight buffers passed to Backend::gemm_quant.

Not every field is used by every QuantKind — e.g. GGUF packs scales inside qweight, so scales / zeros may be dummies. The Backend implementation is expected to validate the shape for the kind it handles.

Fields

qweight: &'a B::Buffer

scales: Option<&'a B::Buffer>

zeros: Option<&'a B::Buffer>

g_idx: Option<&'a B::Buffer>