Skip to main content

message_overhead

Function message_overhead 

Source
pub fn message_overhead() -> u32
Expand description

Count tokens for a role prefix (e.g., “user: “, “assistant: “). Each message has overhead for role markers and formatting.