Module compression

Module compression 

Source
Expand description

Vector compression for OmenDB storage

Provides multiple compression methods:

  • Binary (BBQ): 32x compression, ~85% raw recall (~95% with rescore)
  • Scalar (SQ8): 4x compression, ~97% recall, 2-3x faster than FP32
  • RaBitQ: 8x compression, ~98% recall
  • FastScan: SIMD-accelerated batched distance computation (5x speedup)

Re-exports§

pub use binary::hamming_distance;
pub use binary::BinaryParams;
pub use fastscan::fastscan_batch;
pub use fastscan::fastscan_batch_with_lut;
pub use fastscan::FastScanLUT;
pub use fastscan::BATCH_SIZE as FASTSCAN_BATCH_SIZE;
pub use rabitq::ADCTable;
pub use rabitq::QuantizationBits;
pub use rabitq::QuantizedVector;
pub use rabitq::RaBitQ;
pub use rabitq::RaBitQParams;
pub use rabitq::TrainedParams;
pub use scalar::symmetric_l2_squared_u8;
pub use scalar::QueryPrep;
pub use scalar::ScalarParams;

Modules§

binary
Binary Quantization (BBQ) for OmenDB
fastscan
FastScan SIMD-accelerated distance computation for quantized vectors
rabitq
Multi-bit Scalar Quantization for OmenDB
scalar
Scalar Quantization (SQ8) for OmenDB