Skip to main content

RerankInitOptions

fastembed

Type Alias RerankInitOptions 

Source 
pub type RerankInitOptions = InitOptionsWithLength<RerankerModel>;
Expand description

Options for initializing the reranking models

Aliased Type§

pub struct RerankInitOptions {
    pub model_name: RerankerModel,
    pub execution_providers: Vec<ExecutionProviderDispatch>,
    pub cache_dir: PathBuf,
    pub show_download_progress: bool,
    pub max_length: usize,
    pub intra_threads: Option<usize>,
}

Fields§

§model_name: RerankerModel§execution_providers: Vec<ExecutionProviderDispatch>§cache_dir: PathBuf§show_download_progress: bool§max_length: usize§intra_threads: Option<usize>

Number of intra-op threads for ONNX Runtime. None (the default) uses every available CPU core via std::thread::available_parallelism. Set this to cap CPU usage (e.g. on laptops) at the cost of throughput.