Skip to main content

MessageTokenCounter

Trait MessageTokenCounter 

Source
pub trait MessageTokenCounter: Send + Sync {
    // Required method
    fn count_message_tokens(&self, msg: &Message) -> usize;
}
Expand description

Token counting for individual messages, used by the summarization chunker.

Implemented by zeph-memory::TokenCounter in zeph-core. Defined here so zeph-context does not need a direct dependency on zeph-memory.

Required Methods§

Source

fn count_message_tokens(&self, msg: &Message) -> usize

Return the token count for the given message, accounting for all parts.

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§