Enum QuantizationStrategy 

pub enum QuantizationStrategy {
    None,
    Dynamic,
    Static,
    PostTraining,
    QAT,
    AWQ,
    GPTQ,
    SmoothQuant,
    LLMInt8,
    QLoRA,
    GGML,
    AdaptiveBitwidth,
    OutlierAware,
    HQQ,
    SpQR,
    AQLM,
}

Quantization strategies

Variants

None

No quantization

Dynamic

Dynamic quantization - quantize weights only

Static

Static quantization - quantize weights and activations

PostTraining

Post-training quantization

QAT

Quantization-aware training (requires pre-quantized model)

AWQ

AWQ (Activation-aware Weight Quantization) - preserves important weights

GPTQ

GPTQ (Gradient-based Post-Training Quantization) - uses second-order information

SmoothQuant

SmoothQuant - balances weights and activations difficulty

LLMInt8

LLM.int8() - mixed-precision quantization for large models

QLoRA

QLoRA - Quantized Low-Rank Adaptation

GGML

GGML-style quantization for efficient inference

AdaptiveBitwidth

Adaptive bitwidth quantization with dynamic allocation

OutlierAware

Outlier-aware quantization for handling activation spikes

HQQ

HQQ (Half-Quadratic Quantization) - superior quality quantization using half-quadratic optimization

SpQR

SpQR (Sparse-Quantized Representation) - ultra-sparse models with mixed precision

AQLM

AQLM (Additive Quantization for Language Models) - additive quantization for transformers

Trait Implementations

impl Clone for QuantizationStrategy

fn clone(&self) -> QuantizationStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for QuantizationStrategy

impl Debug for QuantizationStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for QuantizationStrategy

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for QuantizationStrategy

impl From<QuantizationStrategy> for JsValue

fn from(value: QuantizationStrategy) -> Self

Converts to this type from the input type.

impl FromWasmAbi for QuantizationStrategy

type Abi = u32

The Wasm ABI type that this converts from when coming back out from the ABI boundary.

unsafe fn from_abi(js: u32) -> Self

Recover a Self from Self::Abi.

impl IntoWasmAbi for QuantizationStrategy

type Abi = u32

The Wasm ABI type that this converts into when crossing the ABI boundary.

fn into_abi(self) -> u32

Convert self into Self::Abi so that it can be sent across the wasm ABI boundary.

impl OptionFromWasmAbi for QuantizationStrategy

fn is_none(val: &Self::Abi) -> bool

Tests whether the argument is a “none” instance. If so it will be deserialized as None, and otherwise it will be passed to FromWasmAbi.

impl OptionIntoWasmAbi for QuantizationStrategy

fn none() -> Self::Abi

Returns an ABI instance indicating “none”, which JS will interpret as the None branch of this option.

impl PartialEq for QuantizationStrategy

fn eq(&self, other: &QuantizationStrategy) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for QuantizationStrategy

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for QuantizationStrategy

impl TryFromJsValue for QuantizationStrategy

fn try_from_js_value_ref(value: &JsValue) -> Option<Self>

Performs the conversion.

fn try_from_js_value(value: JsValue) -> Result<Self, JsValue>

Performs the conversion.

impl VectorFromWasmAbi for QuantizationStrategy

type Abi = <Box<[JsValue]> as FromWasmAbi>::Abi

unsafe fn vector_from_abi(js: Self::Abi) -> Box<[QuantizationStrategy]>

impl VectorIntoWasmAbi for QuantizationStrategy

type Abi = <Box<[JsValue]> as IntoWasmAbi>::Abi

fn vector_into_abi(vector: Box<[QuantizationStrategy]>) -> Self::Abi

impl WasmDescribe for QuantizationStrategy

fn describe()

impl WasmDescribeVector for QuantizationStrategy

fn describe_vector()