Struct QuantizationParams 

pub struct QuantizationParams {
    pub qtype: QuantizationType,
    pub scale: Vec<f64>,
    pub zero_point: Vec<i32>,
    pub granularity: QuantizationGranularity,
    pub symmetry: QuantizationSymmetry,
    pub observed_min: Option<f64>,
    pub observed_max: Option<f64>,
}

Quantization parameters for a tensor.

Fields

qtype: QuantizationType

Quantization type

scale: Vec<f64>

Scale factor(s)

zero_point: Vec<i32>

Zero point(s)

granularity: QuantizationGranularity

Granularity

symmetry: QuantizationSymmetry

Symmetry mode

observed_min: Option<f64>

Observed min/max during calibration (for validation)

observed_max: Option<f64>

Implementations

impl QuantizationParams

pub fn symmetric_per_tensor( qtype: QuantizationType, abs_max: f64, ) -> Result<Self, QuantizationError>

Create symmetric per-tensor quantization parameters.

pub fn asymmetric_per_tensor( qtype: QuantizationType, min: f64, max: f64, ) -> Result<Self, QuantizationError>

Create asymmetric per-tensor quantization parameters.

pub fn quantize(&self, value: f64) -> i32

Quantize a floating-point value to integer.

pub fn dequantize(&self, qvalue: i32) -> f64

Dequantize an integer value to floating-point.

Trait Implementations

impl Clone for QuantizationParams

fn clone(&self) -> QuantizationParams

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QuantizationParams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for QuantizationParams

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for QuantizationParams

fn eq(&self, other: &QuantizationParams) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for QuantizationParams

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for QuantizationParams