Struct ModelInfo 

pub struct ModelInfo {
    pub context_window: u32,
    pub effective_context_window_percent: u16,
}

Per-model context facts, looked up by slug.

Fields

context_window: u32

Maximum total tokens (prompt + generation) the model accepts.

effective_context_window_percent: u16

Whole-percent fraction of context_window that is considered usable (default 95). usable = context_window * pct / 100.

Implementations

impl ModelInfo

pub const DEFAULT_EFFECTIVE_PERCENT: u16 = 95

Default usable fraction of a model’s window — reserved headroom so the prompt never runs flush against the hard limit.

pub const fn new(context_window: u32) -> Self

A catalog entry with the default effective percentage.

pub const fn effective_window(self) -> u32

floor(context_window * effective_context_window_percent / 100): the usable token budget after reserving headroom.

Trait Implementations

impl Clone for ModelInfo

fn clone(&self) -> ModelInfo

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for ModelInfo

impl Debug for ModelInfo

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for ModelInfo

impl PartialEq for ModelInfo

fn eq(&self, other: &ModelInfo) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for ModelInfo