Struct RuntimeConfig 

pub struct RuntimeConfig {
    pub pool_workers: usize,
    pub par_threshold: usize,
    pub min_rows_per_thread: usize,
    pub sdpa_seq_threshold: usize,
    pub arena_alignment: usize,
    pub ln_eps_default: f32,
    pub attn_mask_neg_inf: f32,
    pub score_skip_threshold: f32,
    pub mask_binary_threshold: f32,
    pub verbose: u8,
}

Runtime configuration for the RLX CPU backend.

Fields

pool_workers: usize

par_threshold: usize

min_rows_per_thread: usize

sdpa_seq_threshold: usize

arena_alignment: usize

ln_eps_default: f32

attn_mask_neg_inf: f32

score_skip_threshold: f32

mask_binary_threshold: f32

verbose: u8

Implementations

impl RuntimeConfig

pub fn auto_detect() -> Self

Auto-detect hardware and apply optimal defaults.

pub fn from_env() -> Self

Auto-detect then override from RLX_* environment variables.

pub fn install(&self)

Push this config into the global rlx_ir::env override map so all RLX backends see the same knobs without setting process env vars.

pub fn global() -> &'static RuntimeConfig

Get or initialize the global singleton config.

Trait Implementations

impl Clone for RuntimeConfig

fn clone(&self) -> RuntimeConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RuntimeConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for RuntimeConfig

fn default() -> Self

Returns the “default value” for a type.