Skip to main content

quantized_data_len

Function quantized_data_len 

Source
pub fn quantized_data_len(scheme: &QuantScheme, shape: &Shape) -> usize
Expand description

Total bytes a tensor of shape occupies under scheme, laid out as QuantizedBytes::new writes it: values, then block scales, then (for a two-level scheme) the per-tensor scale.