Enum QuantizationType 

#[repr(i32)]
pub enum QuantizationType {
    Q4_0 = 2,
    Q4_1 = 3,
    Q5_0 = 8,
    Q5_1 = 9,
    Q8_0 = 7,
    Q2_K = 10,
    Q3_K = 11,
    Q4_K = 12,
    Q5_K = 13,
    Q6_K = 14,
}

Quantization types supported by whisper.cpp

Variants

Q4_0 = 2

4-bit quantization (method 0) - ~3.5 GB for base model

Q4_1 = 3

4-bit quantization (method 1) - ~3.9 GB for base model

Q5_0 = 8

5-bit quantization (method 0) - ~4.3 GB for base model

Q5_1 = 9

5-bit quantization (method 1) - ~4.7 GB for base model

Q8_0 = 7

8-bit quantization - ~7.7 GB for base model

Q2_K = 10

2-bit k-quantization

Q3_K = 11

3-bit k-quantization

Q4_K = 12

4-bit k-quantization

Q5_K = 13

5-bit k-quantization

Q6_K = 14

6-bit k-quantization

Implementations

impl QuantizationType

pub fn name(&self) -> &'static str

Get a human-readable name for the quantization type

pub fn size_factor(&self) -> f32

Estimate the size reduction factor for this quantization type. Returns the approximate size as a fraction of the original F32 model.

pub fn all() -> &'static [QuantizationType]

Get all available quantization types

Trait Implementations

impl Clone for QuantizationType

fn clone(&self) -> QuantizationType

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QuantizationType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for QuantizationType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl FromStr for QuantizationType

type Err = QuantizeError

The associated error which can be returned from parsing.

fn from_str(s: &str) -> Result<Self, Self::Err>

Parses a string s to return a value of this type.

impl PartialEq for QuantizationType

fn eq(&self, other: &QuantizationType) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for QuantizationType

impl Eq for QuantizationType

impl StructuralPartialEq for QuantizationType