Skip to main content

Module rerank

Module rerank 

Source
Expand description

Rerank builder and int8 quantization with outlier handling.

Uses percentile-based symmetric quantization with separate outlier storage to preserve dot product accuracy.

Structs§

RerankBuilder
Builder for rerank data (int8 embeddings + outliers)
Reranker
Reranker for computing int8 dot products with outlier correction

Functions§

quantize_query
Quantize a query vector for reranking