Struct ContextLimit 

pub struct ContextLimit {
    pub max_tokens: usize,
    pub reserved_response_tokens: usize,
    pub chars_per_token: usize,
}

Configuration for estimating context usage.

Fields

max_tokens: usize

Maximum tokens available in the session context window.

reserved_response_tokens: usize

Tokens reserved for the model’s next response.

chars_per_token: usize

Estimated characters per token (English ~3-4, CJK ~1).

Implementations

impl ContextLimit

pub fn new(max_tokens: usize) -> Self

Creates a new context limit with a max token budget.

pub fn default_on_device() -> Self

Creates a default configuration for on-device models.

pub fn with_reserved_response_tokens(self, tokens: usize) -> Self

Sets the reserved response tokens.

pub fn with_chars_per_token(self, chars: usize) -> Self

Sets the character-per-token estimate.

Trait Implementations

impl Clone for ContextLimit

fn clone(&self) -> ContextLimit

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ContextLimit

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Copy for ContextLimit