Struct QuantizationParams 

pub struct QuantizationParams {
    pub tensor_type: GGUFTensorType,
    pub block_size: usize,
    pub bits_per_weight: f32,
    pub has_scales: bool,
    pub has_min: bool,
    pub has_high_bits: bool,
    pub block_size_bytes: usize,
}

Quantization parameters for different tensor types

Fields

tensor_type: GGUFTensorType

The tensor type this applies to

block_size: usize

Block size (number of elements per quantization block)

bits_per_weight: f32

Physical storage bits per weight, including block metadata overhead

has_scales: bool

Whether this format supports scales

has_min: bool

Whether this format supports minimum values

has_high_bits: bool

Whether this format has high-bit extensions

block_size_bytes: usize

Size of each block in bytes

Implementations

impl QuantizationParams

pub fn for_type(tensor_type: TensorType) -> Self

Get quantization parameters for a tensor type

pub fn is_supported(&self) -> bool

Whether GGUF readers and writers support this tensor type.

pub fn calculate_storage_size(&self, element_count: u64) -> Option<u64>

Calculate the storage size for a given number of elements.

Returns None for unsupported tensor types and on arithmetic overflow.

pub fn calculate_num_blocks(&self, element_count: u64) -> u64

Calculate the number of blocks needed for a given element count

Trait Implementations

impl Clone for QuantizationParams

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QuantizationParams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for QuantizationParams

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Display for QuantizationParams

Available on crate feature std only.

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for QuantizationParams

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for QuantizationParams

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for QuantizationParams