pub fn count_message_tokens( tokenizer: &dyn Tokenizer, message: &Message, ) -> usize
Sum the token counts of a message’s text content (text and reasoning content items) using tokenizer.
tokenizer