Struct HeuristicTokenCounter 

pub struct HeuristicTokenCounter { /* private fields */ }

Estimates token cost from UTF-8 lengths, rounded up per text-bearing part. Tool calls count name bytes plus serialized argument bytes. Attachments and message overhead have fixed costs.

use rig_core::completion::Message;
use rig_memory::{HeuristicTokenCounter, TokenCounter};

let counter = HeuristicTokenCounter::default();
assert_eq!(counter.count(&Message::user("12345678")), 2 + 4);

Implementations

impl HeuristicTokenCounter

pub fn new( bytes_per_token: f32, per_message_overhead: usize, per_attachment_tokens: usize, ) -> Self

A counter with these parameters.

Non-finite ratios and ratios below 1.0 become 1.0. Overhead and attachment costs may be zero.

pub fn anthropic() -> Self

Uses 3.5 bytes per token, four tokens per message, and ATTACHMENT_TOKENS per attachment.

pub fn count_tool(&self, tool: &ToolDefinition) -> usize

About how many tokens the definition of a tool costs as a request sends it: its name, description and parameters’ JSON.

Trait Implementations

impl Clone for HeuristicTokenCounter

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for HeuristicTokenCounter

impl Debug for HeuristicTokenCounter

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for HeuristicTokenCounter

fn default() -> Self

Uses four bytes per token, four tokens per message, and ATTACHMENT_TOKENS per attachment.

impl TokenCounter for HeuristicTokenCounter

fn count(&self, message: &Message) -> usize

About how many tokens message costs.