pub trait TokenCounter: Send + Sync {
// Required methods
fn count_messages(&self, messages: &[Message]) -> u32;
fn count_text(&self, text: &str) -> u32;
}Expand description
How messages should be counted for trimming.
Required Methods§
Sourcefn count_messages(&self, messages: &[Message]) -> u32
fn count_messages(&self, messages: &[Message]) -> u32
Count tokens in a slice of messages.
Sourcefn count_text(&self, text: &str) -> u32
fn count_text(&self, text: &str) -> u32
Count tokens in a text string.
Dyn Compatibility§
This trait is dyn compatible.
In older versions of Rust, dyn compatibility was called "object safety".