Struct QuantizeConfig 

pub struct QuantizeConfig {
    pub group_size: usize,
    pub symmetric: bool,
}

Configuration for quantization operations.

Fields

group_size: usize

Group size for block-wise quantization. Smaller groups = more scales = higher accuracy. 0 = per-tensor, otherwise per-group.

symmetric: bool

Whether to use symmetric quantization.

Implementations

impl QuantizeConfig

pub fn with_group_size(self, size: usize) -> QuantizeConfig

Set group size.

Trait Implementations

impl Clone for QuantizeConfig

fn clone(&self) -> QuantizeConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QuantizeConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for QuantizeConfig

fn default() -> QuantizeConfig

Returns the “default value” for a type.