Enum BitWidth 

pub enum BitWidth {
    Int2 = 2,
    Int4 = 4,
    Int8 = 8,
    Fp16 = 16,
    Fp32 = 32,
}

Quantization bit-widths supported for model layers.

Variants

Int2 = 2

Int4 = 4

Int8 = 8

Fp16 = 16

Fp32 = 32

Implementations

impl BitWidth

pub fn bytes_per_weight(&self) -> f64

Number of bytes consumed per weight element at this precision.

pub fn compression_ratio_vs_fp32(&self) -> f64

Compression ratio relative to Fp32 (higher = more compressed).

Trait Implementations

impl Clone for BitWidth

fn clone(&self) -> BitWidth

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for BitWidth

impl Debug for BitWidth

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for BitWidth

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for BitWidth

impl Ord for BitWidth

fn cmp(&self, other: &BitWidth) -> Ordering

This method returns an Ordering between self and other.

fn max(self, other: Self) -> Self

where Self: Sized,

Compares and returns the maximum of two values.

fn min(self, other: Self) -> Self

where Self: Sized,

Compares and returns the minimum of two values.

fn clamp(self, min: Self, max: Self) -> Self

where Self: Sized,

Restrict a value to a certain interval.

impl PartialEq for BitWidth

fn eq(&self, other: &BitWidth) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl PartialOrd for BitWidth

fn partial_cmp(&self, other: &BitWidth) -> Option<Ordering>

This method returns an ordering between self and other values if one exists.

fn lt(&self, other: &Rhs) -> bool

Tests less than (for self and other) and is used by the < operator.

fn le(&self, other: &Rhs) -> bool

Tests less than or equal to (for self and other) and is used by the <= operator.

fn gt(&self, other: &Rhs) -> bool

Tests greater than (for self and other) and is used by the > operator.

fn ge(&self, other: &Rhs) -> bool

Tests greater than or equal to (for self and other) and is used by the >= operator.

impl StructuralPartialEq for BitWidth