Skip to main content

OpqCodec

Struct OpqCodec 

Source
pub struct OpqCodec {
    pub dim: usize,
    pub m: usize,
    pub k: usize,
    pub sub_dim: usize,
    /* private fields */
}
Expand description

Optimized Product Quantization codec.

Stores a learned rotation matrix R (dim × dim, row-major) and PQ codebooks trained on the rotated training set via Non-Para OPQ iterations.

Fields§

§dim: usize§m: usize

Number of PQ subspaces.

§k: usize

Centroids per subspace (256 for u8 codes).

§sub_dim: usize

Implementations§

Source§

impl OpqCodec

Source

pub fn train( vectors: &[&[f32]], dim: usize, m: usize, k: usize, opq_iters: usize, kmeans_iters: usize, ) -> Self

Train an OPQ codec using the Non-Para OPQ algorithm.

Alternates between a codebook step (Lloyd’s k-means on the rotated training set) and a Procrustes step (SVD-based rotation update to minimize reconstruction error) for opq_iters iterations.

  • opq_iters: number of alternating Procrustes+codebook iterations.
  • kmeans_iters: Lloyd’s k-means iterations per subspace per OPQ iter.
Source

pub fn apply_rotation(&self, v: &[f32]) -> Vec<f32>

Apply the rotation matrix to v, returning R · v.

Trait Implementations§

Source§

impl VectorCodec for OpqCodec

Source§

fn prepare_query(&self, q: &[f32]) -> Self::Query

Rotate the query, then build flat ADC distance table [M × K].

Source§

fn fast_symmetric_distance( &self, q: &Self::Quantized, v: &Self::Quantized, ) -> f32

Symmetric: dequantize both sides in rotated space, compute L2.

Source§

fn exact_asymmetric_distance(&self, q: &Self::Query, v: &Self::Quantized) -> f32

Asymmetric: O(M) ADC table lookups — one per subspace.

Source§

type Quantized = OpqQuantized

The packed quantized form. Must be convertible to a UnifiedQuantizedVector reference via AsRef.
Source§

type Query = OpqQuery

The prepared query form (codec-specific).
Source§

fn encode(&self, v: &[f32]) -> Self::Quantized

Encode a single FP32 vector into the codec’s packed form.
Source§

fn adc_lut(&self, q: &Self::Query) -> Option<AdcLut>

Optional: precompute ADC lookup table for codecs that use one (PQ, IVF-PQ, TurboQuant). Returns None for codecs that don’t (RaBitQ, BBQ, ternary, binary).
Source§

fn train(&mut self, samples: &[&[f32]]) -> Result<(), CodecError>

Optional: fit the codec’s learned parameters on a set of training vectors. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<SS, SP> SupersetOf<SS> for SP
where SS: SubsetOf<SP>,

Source§

fn to_subset(&self) -> Option<SS>

The inverse inclusion map: attempts to construct self from the equivalent element of its superset. Read more
Source§

fn is_in_subset(&self) -> bool

Checks if self is actually part of its subset T (and can be converted to it).
Source§

fn to_subset_unchecked(&self) -> SS

Use with care! Same as self.to_subset but without any property checks. Always succeeds.
Source§

fn from_subset(element: &SS) -> SP

The inclusion map: converts self to the equivalent element of its superset.
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.