Struct ContextWindow 

pub struct ContextWindow {
    pub max_tokens: usize,
    pub reserved_for_response: usize,
    /* private fields */
}

Manages context for LLM prompts

Fields

max_tokens: usize

Maximum tokens for context

reserved_for_response: usize

Reserved tokens for response

Implementations

impl ContextWindow

pub fn new(max_tokens: usize) -> Self

Create a new context window

pub fn add_segment(&mut self, segment: ContextSegment)

Add a context segment

pub fn build(&mut self) -> String

Build the final context, respecting token limits

pub fn token_usage(&self) -> (usize, usize)

Get current token usage

Trait Implementations

impl Clone for ContextWindow

fn clone(&self) -> ContextWindow

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ContextWindow

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.