Struct TokenLimit 

pub struct TokenLimit {
    pub total_limit: u64,
    pub compaction_buffer_pct: f64,
}

Context window limit configuration for a model.

Defines the total token limit and reserved buffer percentage for context management operations.

Fields

total_limit: u64

Total context window size in tokens.

compaction_buffer_pct: f64

Percentage of context reserved for compaction/management (0-100).

Implementations

impl TokenLimit

pub fn new(total_limit: u64, compaction_buffer_pct: f64) -> Self

Create a new token limit with validation.

Panics

Panics if compaction_buffer_pct is not in range 0-100.

pub fn effective_limit(&self) -> u64

Calculate effective usable token limit after buffer reservation.

Returns the actual number of tokens available for use after subtracting the compaction buffer.

Trait Implementations

impl Clone for TokenLimit

fn clone(&self) -> TokenLimit

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenLimit

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.