Enum QuantizationScheme 

#[repr(u8)]
pub enum QuantizationScheme {
    None = 0,
    GptqInt4 = 1,
    AwqInt4 = 2,
    SymmetricInt8 = 3,
    AsymmetricInt8 = 4,
}

Quantization scheme identifier.

Variants

None = 0

No quantization (full precision).

GptqInt4 = 1

GPTQ-style INT4 quantization.

AwqInt4 = 2

AWQ-style INT4 quantization.

SymmetricInt8 = 3

Symmetric INT8 quantization.

AsymmetricInt8 = 4

Asymmetric INT8 quantization.

Trait Implementations

impl Clone for QuantizationScheme

fn clone(&self) -> QuantizationScheme

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QuantizationScheme

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for QuantizationScheme

fn default() -> QuantizationScheme

Returns the “default value” for a type.

impl PartialEq for QuantizationScheme

fn eq(&self, other: &QuantizationScheme) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl TryFrom<u8> for QuantizationScheme

type Error = Error

The type returned in the event of a conversion error.

fn try_from(value: u8) -> Result<Self>

Performs the conversion.

impl Copy for QuantizationScheme

impl Eq for QuantizationScheme

impl StructuralPartialEq for QuantizationScheme