pub fn decode_bytes(
model: &CatalogModel,
quant: &Quantization,
) -> Result<Option<f64>, ValidationError>Expand description
Bytes read per decoded token (active weights at the quantization’s bit width), or None
when no sourced estimate exists (1-bit quants, MoE without active params or known bits).