Struct QuantizedCacheConfig 

pub struct QuantizedCacheConfig {
    pub scheme: QuantizationScheme,
    pub sq_bits: u8,
    pub pq_n_subspaces: usize,
    pub pq_n_centroids: usize,
    pub pq_max_iters: usize,
    pub normalize: bool,
    pub max_training_samples: usize,
}

Configuration for QuantizedEmbeddingCache.

Fields

scheme: QuantizationScheme

Which quantization scheme to use.

sq_bits: u8

For SQ: number of bits (currently fixed at 8).

pq_n_subspaces: usize

For PQ: number of sub-spaces.

pq_n_centroids: usize

For PQ: number of centroids per codebook.

pq_max_iters: usize

For PQ: number of k-means iterations during training.

normalize: bool

Whether to normalize vectors before quantization.

max_training_samples: usize

Maximum number of training samples to use.

Trait Implementations

impl Clone for QuantizedCacheConfig

fn clone(&self) -> QuantizedCacheConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QuantizedCacheConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for QuantizedCacheConfig

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for QuantizedCacheConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for QuantizedCacheConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.