Struct CharTokenCounter 

pub struct CharTokenCounter;

Approximate token counter using character count / 4.

Suitable for tests — no tokenizer dependency required. For production, implement TokenCounter with a real tokenizer (tiktoken, etc.).

Trait Implementations

impl TokenCounter for CharTokenCounter

fn count_messages(&self, messages: &[Message]) -> u32

Count tokens in a slice of messages.

fn count_text(&self, text: &str) -> u32

Count tokens in a text string.