Struct CrossEncoderReranker 

pub struct CrossEncoderReranker { /* private fields */ }

Implementations

impl CrossEncoderReranker

pub fn new() -> Result<Self>

pub async fn warmup(self: &Arc<Self>) -> Result<()>

Eagerly load the ONNX session for warm start.

pub fn try_unload_if_idle(&self) -> bool

Drops the ONNX session if idle for longer than the timeout.

pub async fn maintenance_tick(self: &Arc<Self>)

Periodic maintenance entry-point.

pub fn score_batch(&self, query: &str, passages: &[&str]) -> Result<Vec<f32>>

Score a batch of query-passage pairs. Returns a relevance score (0-1) for each.

Trait Implementations

impl Debug for CrossEncoderReranker

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.