quantize_adaptive

Function quantize_adaptive 

Source
pub fn quantize_adaptive(
    emb: &Vector,
    target: AccuracyTarget,
) -> Result<QuantizedVector, QuantError>
Expand description

Quantize an embedding based on an accuracy target

§Arguments

  • emb - The embedding vector to quantize
  • target - The desired accuracy level

§Returns

  • Ok(QuantizedVector) - The quantized vector using the selected scheme
  • Err(QuantError) - If quantization fails

§Example

use lnmp_quant::adaptive::{quantize_adaptive, AccuracyTarget};
use lnmp_embedding::Vector;

let vec = Vector::from_f32(vec![0.1, 0.2, 0.3]);
let q = quantize_adaptive(&vec, AccuracyTarget::High).unwrap();