Enum TargetFormat 

pub enum TargetFormat {
    Q4_K_M,
    Q5_K_M,
    Q8_0,
    F16,
    PiQ3,
    PiQ2,
}

Target quantization format

Variants

Q4_K_M

4-bit K-quant with medium quality (best quality/size tradeoff)

Q5_K_M

5-bit K-quant with medium quality (higher quality)

Q8_0

8-bit symmetric quantization (near-lossless)

F16

FP16 (no quantization, half precision)

PiQ3

Pi-constant 3-bit quantization (ADR-090)

Uses pi-scaled step sizes: step = alpha * pi / k Provides ~0.5 effective bits better precision than uniform 3-bit. Storage: 3.0625 bits/weight (including scale overhead)

PiQ2

Pi-constant 2-bit quantization (ADR-090)

Ultra-low-bit format for extreme compression. Uses pi-scaled step sizes: step = alpha * pi / k Storage: 2.0625 bits/weight (including scale overhead)

Implementations

impl TargetFormat

pub fn to_gguf_type(&self) -> GgufQuantType

Get the GGUF quantization type

pub fn bits_per_weight(&self) -> f32

Get bits per weight (including scale overhead)

pub fn block_size(&self) -> usize

Get the block size (number of weights per quantization block)

pub fn from_str(s: &str) -> Option<Self>

Parse from string

pub fn name(&self) -> &'static str

Get format name for display

pub fn is_pi_quant(&self) -> bool

Check if this is a pi-quantization format

pub fn raw_bits(&self) -> u8

Get the number of quantization bits (without overhead)

Trait Implementations

impl Clone for TargetFormat

fn clone(&self) -> TargetFormat

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TargetFormat

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for TargetFormat

fn eq(&self, other: &TargetFormat) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for TargetFormat

impl Eq for TargetFormat

impl StructuralPartialEq for TargetFormat