Expand description
Rerank builder and int8 quantization with outlier handling.
Uses percentile-based symmetric quantization with separate outlier storage to preserve dot product accuracy.
Structs§
- Rerank
Builder - Builder for rerank data (int8 embeddings + outliers)
- Reranker
- Reranker for computing int8 dot products with outlier correction
Functions§
- quantize_
query - Quantize a query vector for reranking