Struct LlmReranker 

pub struct LlmReranker { /* private fields */ }

LLM reranking over the OpenAI-compatible /chat/completions protocol.

Implementations

impl LlmReranker

pub fn openai_compatible(base_url: &str, model: &str, api_key: &str) -> Self

Trait Implementations

impl Reranker for LlmReranker

fn rerank(&self, query: &str, docs: &[&str]) -> Result<Vec<f32>>

Relevance of each document to the query, in input order, each in 0..=1. Must return exactly docs.len() scores.