Skip to main content

estimate_tokens

Function estimate_tokens 

Source
pub fn estimate_tokens(value: &str) -> u64
Expand description

Deterministic token estimate: ceil(utf8_bytes / 4).