Struct ContextWindow 

pub struct ContextWindow {
    pub max_tokens: usize,
    pub response_reserve: usize,
    pub system_reserve: usize,
    pub history_minimum: usize,
}

Context window configuration and management

Fields

max_tokens: usize

Maximum tokens in context window

response_reserve: usize

Reserved tokens for the response

system_reserve: usize

Reserved tokens for system message

history_minimum: usize

Minimum tokens to keep from conversation history

Implementations

impl ContextWindow

pub fn new(max_tokens: usize) -> Self

Create new context window configuration

pub fn available_for_history(&self) -> usize

Get available tokens for conversation history

pub fn fits(&self, token_count: usize) -> bool

Check if token count fits in context window

pub fn tokens_to_truncate(&self, current_tokens: usize) -> usize

Calculate how many tokens to truncate

Trait Implementations

impl Clone for ContextWindow

fn clone(&self) -> ContextWindow

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ContextWindow

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for ContextWindow

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for ContextWindow

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.