Struct RerankInitOptionsUserDefined 

#[non_exhaustive]
pub struct RerankInitOptionsUserDefined {
    pub execution_providers: Vec<ExecutionProviderDispatch>,
    pub max_length: usize,
    pub intra_threads: Option<usize>,
}

Options for initializing UserDefinedRerankerModel

Model files are held by the UserDefinedRerankerModel struct

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

execution_providers: Vec<ExecutionProviderDispatch>

max_length: usize

intra_threads: Option<usize>

Number of intra-op threads for ONNX Runtime. None (the default) uses every available CPU core via std::thread::available_parallelism. Set this to cap CPU usage (e.g. on laptops) at the cost of throughput.

Implementations

impl RerankInitOptionsUserDefined

pub fn with_intra_threads(self, intra_threads: usize) -> Self

Set the number of intra-op threads ONNX Runtime uses. By default (None) all available CPU cores are used; capping this limits CPU usage at the cost of per-inference throughput.

Trait Implementations

impl Clone for RerankInitOptionsUserDefined

fn clone(&self) -> RerankInitOptionsUserDefined

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RerankInitOptionsUserDefined

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for RerankInitOptionsUserDefined

fn default() -> Self

Returns the “default value” for a type.

impl From<InitOptionsWithLength<RerankerModel>> for RerankInitOptionsUserDefined

Convert RerankInitOptions to RerankInitOptionsUserDefined

This is useful for when the user wants to use the same options for both the default and user-defined models

fn from(options: RerankInitOptions) -> Self

Converts to this type from the input type.