Skip to main content

Module reranker

Module reranker 

Source
Expand description

Cross-encoder reranker for improving recall precision.

Uses BAAI/bge-reranker-base (Xenova ONNX INT8 quantized) to score (query, passage) pairs for relevance. More accurate than bi-encoder vector similarity but slower — used as a second-stage reranker after ANN candidate retrieval.

§Architecture

query + passage → [CLS] query [SEP] passage [SEP]
                      ↓ BERT forward pass
                  logits [batch, 1]
                      ↓ sigmoid
                  relevance scores ∈ [0, 1]

Structs§

CrossEncoderEngine
Cross-encoder reranking engine.