Trait MessageTokenCounter 

pub trait MessageTokenCounter: Send + Sync {
    // Required method
    fn count_message_tokens(&self, msg: &Message) -> usize;
}

Token counting for individual messages, used by the summarization chunker.

Implemented by zeph-memory::TokenCounter in zeph-core. Defined here so zeph-context does not need a direct dependency on zeph-memory.

Required Methods

fn count_message_tokens(&self, msg: &Message) -> usize

Return the token count for the given message, accounting for all parts.

Implementors