Module backend 

Backend abstraction layer.

Post-v3.0.0 the only backend is the CPU cross-encoder reranker ([cpu::CpuRerankBackend], backed by [cpu::CpuBertModel]). The RerankBackend trait, Encoding input type, and [BackendKind] discriminant survive; the [EmbedBackend] trait and bi-encoder load_backend / detect_backends entry points were removed when the transformer engines came out.

Modules

blas_info

Runtime BLAS detection and optimization recommendations.

Structs

Encoding

Pre-tokenized encoding ready for inference.

Traits

RerankBackend

Trait for cross-encoder rerank backends.

Functions

load_reranker_cpu