Skip to main content

estimate_message_tokens

llm_stack::context

Function estimate_message_tokens 

Source 
pub fn estimate_message_tokens(message: &ChatMessage) -> u32
Expand description

Estimates tokens for a chat message.

Includes a small overhead for role markers and message structure.