Struct Quantizer 

pub struct Quantizer {
    pub calibration: Calibration,
    pub scheme: QuantScheme,
    pub group: ParamGroup,
    /* private fields */
}

Describes how to quantize a module.

Fields

calibration: Calibration

The calibration method used in quantization.

scheme: QuantScheme

The quantization scheme.

group: ParamGroup

The parameter group to quantize.

Implementations

impl Quantizer

pub fn new(calibration: Calibration, scheme: QuantScheme) -> Self

Create a new Quantizer.

pub fn set_param_group(&mut self, group: ParamGroup)

Set the parameter group to quantize.

Trait Implementations

impl ModuleMapper for Quantizer

fn enter_module(&mut self, name: &str, _container_type: &str)

Called when entering a submodule.

fn exit_module(&mut self, _name: &str, _container_type: &str)

Called when exiting a submodule.

fn map_float<const D: usize>( &mut self, param: Param<Tensor<D>>, ) -> Param<Tensor<D>>

Map a float parameter in the module.

fn map_int<const D: usize>( &mut self, param: Param<Tensor<D, Int>>, ) -> Param<Tensor<D, Int>>

Map an int parameter in the module.

fn map_bool<const D: usize>( &mut self, param: Param<Tensor<D, Bool>>, ) -> Param<Tensor<D, Bool>>

Map a bool parameter in the module.