Trait TokenCounter 

pub trait TokenCounter: Send + Sync {
    // Required method
    fn count_text(&self, text: &str) -> usize;

    // Provided method
    fn count_messages(&self, messages: &[Message]) -> usize { ... }
}

Trait for counting tokens in text and messages.

Required Methods

fn count_text(&self, text: &str) -> usize

Count the number of tokens in a text string.

Provided Methods

fn count_messages(&self, messages: &[Message]) -> usize

Count the total number of tokens in a slice of messages. Default implementation sums count_text(content) + 4 per message overhead.

Implementors

impl TokenCounter for HeuristicTokenCounter