Enum QuantizedDataType 

pub enum QuantizedDataType {
    Int8,
    Int4,
    UInt4,
    Float16,
    BFloat16,
}

The storage type used for quantized data

Variants

Int8

8-bit signed integers

Int4

4-bit signed integers (packed into i8 array)

UInt4

4-bit unsigned integers (packed into i8 array)

Float16

16-bit IEEE 754 half-precision floating point (f16)

BFloat16

16-bit Brain floating point (bf16)

Trait Implementations

impl Clone for QuantizedDataType

fn clone(&self) -> QuantizedDataType

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QuantizedDataType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for QuantizedDataType

impl PartialEq for QuantizedDataType

fn eq(&self, other: &QuantizedDataType) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for QuantizedDataType