Enum QuantScheme 

pub enum QuantScheme {
    Q4_0 {
        group_size: usize,
    },
    Q8_0 {
        group_size: usize,
    },
}

Quantization scheme descriptor for quantized linear ops.

Variants

Q4_0

4-bit quantization with group size (e.g. Q4_0 uses group_size=32).

Fields

group_size: usize

Q8_0

8-bit quantization.

Fields

group_size: usize

Trait Implementations

impl Clone for QuantScheme

fn clone(&self) -> QuantScheme

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QuantScheme

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.