Struct SessionConfig 

pub struct SessionConfig {
    pub thread_count: Option<usize>,
    pub memory_limit: Option<usize>,
    pub optimization_level: OptimizationLevel,
    pub preferred_providers: Vec<ProviderId>,
    pub timeout_seconds: Option<u64>,
    pub max_concurrent_inferences: Option<usize>,
    pub enable_metrics: bool,
    pub custom_options: HashMap<String, String>,
}

Configuration for inference sessions.

Fields

thread_count: Option<usize>

Number of worker threads for this session.

memory_limit: Option<usize>

Memory limit in bytes for this session.

optimization_level: OptimizationLevel

Optimization level for model execution.

preferred_providers: Vec<ProviderId>

Preferred execution providers in priority order.

timeout_seconds: Option<u64>

Session timeout in seconds.

max_concurrent_inferences: Option<usize>

Maximum number of concurrent inferences.

enable_metrics: bool

Enable performance metrics collection.

custom_options: HashMap<String, String>

Custom configuration options.

Trait Implementations

impl Clone for SessionConfig

fn clone(&self) -> SessionConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SessionConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SessionConfig

fn default() -> Self

Returns the “default value” for a type.