Struct SessionLimits 

pub struct SessionLimits {
    pub effective_n_ctx: i32,
    pub effective_max_audio_ms: i64,
    pub max_kv_bytes: i64,
}

Per-session effective limits.

Fields

effective_n_ctx: i32

Decoder context cap in force for this session (0 = unbounded family).

effective_max_audio_ms: i64

Longest accepted audio in ms (0 = no practical limit).

max_kv_bytes: i64

Worst-case decoder KV bytes for one utterance (0 = no decoder KV).

Trait Implementations

impl Clone for SessionLimits

fn clone(&self) -> SessionLimits

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for SessionLimits

impl Debug for SessionLimits

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for SessionLimits

impl PartialEq for SessionLimits

fn eq(&self, other: &SessionLimits) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for SessionLimits