Struct TokenBudget 

pub struct TokenBudget<C: TokenCounter = HeuristicTokenCounter> {
    pub max_tokens: usize,
    pub counter: C,
}

The newest messages within max_tokens, as counter counts them: walking back from the newest, it stops before the first message that does not fit.

Fields

max_tokens: usize

The budget.

counter: C

How a message is counted.

Implementations

impl TokenBudget

pub fn new(max_tokens: usize) -> Self

A budget of max_tokens, counted by the default HeuristicTokenCounter.

Trait Implementations

impl<C: Clone + TokenCounter> Clone for TokenBudget<C>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<C: Copy + TokenCounter> Copy for TokenBudget<C>

impl<C: Debug + TokenCounter> Debug for TokenBudget<C>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<C: TokenCounter> Recent for TokenBudget<C>

fn start(&self, messages: &[Arc<Message>]) -> usize

The index of the first message of messages to keep, at most messages.len().