pub struct Sq8Codec {
pub dim: usize,
/* private fields */
}Expand description
SQ8 calibration parameters: per-dimension min/max.
Fields§
§dim: usizeImplementations§
Source§impl Sq8Codec
impl Sq8Codec
Sourcepub fn calibrate(vectors: &[&[f32]], dim: usize) -> Self
pub fn calibrate(vectors: &[&[f32]], dim: usize) -> Self
Calibrate min/max from a set of training vectors.
Scans all vectors to find per-dimension min/max bounds. At least 1000 vectors recommended for stable calibration; for fewer vectors the bounds may be tight, causing clipping on future inserts outside the calibration range.
Sourcepub fn quantize_batch(&self, vectors: &[&[f32]]) -> Vec<u8> ⓘ
pub fn quantize_batch(&self, vectors: &[&[f32]]) -> Vec<u8> ⓘ
Batch quantize: quantize all vectors into a contiguous byte array.
Returns dim * N bytes laid out as [v0_d0, v0_d1, ..., v1_d0, ...].
Sourcepub fn dequantize(&self, quantized: &[u8]) -> Vec<f32>
pub fn dequantize(&self, quantized: &[u8]) -> Vec<f32>
Dequantize INT8 back to FP32 (lossy reconstruction).
Sourcepub fn asymmetric_l2(&self, query: &[f32], candidate: &[u8]) -> f32
pub fn asymmetric_l2(&self, query: &[f32], candidate: &[u8]) -> f32
Asymmetric L2 squared distance: query (FP32) vs candidate (INT8).
This is the hot-path function used during HNSW traversal. The query stays in full precision; only the candidate is quantized.
Sourcepub fn asymmetric_cosine(&self, query: &[f32], candidate: &[u8]) -> f32
pub fn asymmetric_cosine(&self, query: &[f32], candidate: &[u8]) -> f32
Asymmetric cosine distance: query (FP32) vs candidate (INT8).
Sourcepub fn asymmetric_ip(&self, query: &[f32], candidate: &[u8]) -> f32
pub fn asymmetric_ip(&self, query: &[f32], candidate: &[u8]) -> f32
Asymmetric negative inner product: query (FP32) vs candidate (INT8).
Trait Implementations§
Source§impl<'de> Deserialize<'de> for Sq8Codec
impl<'de> Deserialize<'de> for Sq8Codec
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Auto Trait Implementations§
impl Freeze for Sq8Codec
impl RefUnwindSafe for Sq8Codec
impl Send for Sq8Codec
impl Sync for Sq8Codec
impl Unpin for Sq8Codec
impl UnsafeUnpin for Sq8Codec
impl UnwindSafe for Sq8Codec
Blanket Implementations§
Source§impl<T> ArchivePointee for T
impl<T> ArchivePointee for T
Source§type ArchivedMetadata = ()
type ArchivedMetadata = ()
Source§fn pointer_metadata(
_: &<T as ArchivePointee>::ArchivedMetadata,
) -> <T as Pointee>::Metadata
fn pointer_metadata( _: &<T as ArchivePointee>::ArchivedMetadata, ) -> <T as Pointee>::Metadata
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> LayoutRaw for T
impl<T> LayoutRaw for T
Source§fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>
fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>
Source§impl<T, N1, N2> Niching<NichedOption<T, N1>> for N2
impl<T, N1, N2> Niching<NichedOption<T, N1>> for N2
Source§unsafe fn is_niched(niched: *const NichedOption<T, N1>) -> bool
unsafe fn is_niched(niched: *const NichedOption<T, N1>) -> bool
Source§fn resolve_niched(out: Place<NichedOption<T, N1>>)
fn resolve_niched(out: Place<NichedOption<T, N1>>)
out indicating that a T is niched.