Struct RuntimeConfig 

#[non_exhaustive]
pub struct RuntimeConfig {
    pub model_dir: Option<PathBuf>,
    pub ort_dylib: Option<PathBuf>,
    pub intra_threads: usize,
    pub sessions_per_model: usize,
}

How the shared layer resolves files and sizes its pools.

Threads

intra_threads x sessions_per_model x the caller’s page parallelism should not exceed the cores; one caller-facing thread budget (later, the CLI’s --threads) drives both numbers. There is no automatic pool sizing: what is set here is what runs.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

model_dir: Option<PathBuf>

Explicit model dir; wins over the env var and the default. Model files only: the runtime library never reads this field (see resolve_ort_dylib).

ort_dylib: Option<PathBuf>

Explicit ONNX Runtime library; wins over the env var and the default.

intra_threads: usize

ONNX Runtime intra-op threads per session. Default 4.

sessions_per_model: usize

Sessions per model: a pool so parallel pages/tables do not serialise on one Mutex. Default 1. 0 is clamped to 1 (see below).

Implementations

impl RuntimeConfig

pub fn new() -> Self

A default config: 4 intra threads, a pool of 1, resolved paths.

pub fn with_model_dir(self, dir: impl Into<PathBuf>) -> Self

Set the explicit model dir; wins over everything.

pub fn with_ort_dylib(self, lib: impl Into<PathBuf>) -> Self

Set the explicit ONNX Runtime library; wins over everything.

pub fn with_intra_threads(self, threads: usize) -> Self

Set the ONNX Runtime intra-op threads per session.

pub fn with_sessions_per_model(self, sessions: usize) -> Self

Set the sessions per model.

A pool so parallel pages/tables do not serialise on one Mutex; SharedSession::run blocks until a session is free. 0 would block forever (a pool that can never hold a session), so it is clamped to 1 when the pool is built – the only automatic sizing in this module, and a degenerate-input guard rather than a policy.

Trait Implementations

impl Default for RuntimeConfig

fn default() -> Self

Returns the “default value” for a type.