Skip to main content

TokenCounter

bamboo_compression::counter

Trait TokenCounter 

Source 
pub trait TokenCounter: Send + Sync {
    // Required methods
    fn count_message(&self, message: &Message) -> u32;
    fn count_text(&self, text: &str) -> u32;

    // Provided method
    fn count_messages(&self, messages: &[Message]) -> u32 { ... }
}
Expand description

Trait for token counting implementations.

Required Methods§

Source

fn count_message(&self, message: &Message) -> u32

Count tokens in a single message.

Source

fn count_text(&self, text: &str) -> u32

Count tokens in a plain text string.

Provided Methods§

Source

fn count_messages(&self, messages: &[Message]) -> u32

Count tokens in multiple messages.

Implementors§