Struct RaBitQParams 

pub struct RaBitQParams {
    pub bits_per_dim: QuantizationBits,
    pub num_rescale_factors: usize,
    pub rescale_range: (f32, f32),
}

Configuration for RaBitQ quantization

Fields

bits_per_dim: QuantizationBits

Number of bits per dimension

num_rescale_factors: usize

Number of rescaling factors to try (DEPRECATED: use trained quantizer)

Higher values = better quantization quality but slower Typical range: 8-16

rescale_range: (f32, f32)

Range of rescaling factors to try (DEPRECATED: use trained quantizer)

Typical range: (0.5, 2.0) means try scales from 0.5x to 2.0x

Implementations

impl RaBitQParams

pub fn bits2() -> Self

Create parameters for 2-bit quantization (16x compression)

pub fn bits4() -> Self

Create parameters for 4-bit quantization (8x compression, recommended)

pub fn bits8() -> Self

Create parameters for 8-bit quantization (4x compression, highest quality)

Trait Implementations

impl Clone for RaBitQParams

fn clone(&self) -> RaBitQParams

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RaBitQParams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for RaBitQParams

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for RaBitQParams

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for RaBitQParams

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.