Expand description
Token counting utilities for context management.
Provides both approximate (character-based) and accurate (tiktoken-based) token estimation for message lists.
Structs§
- Char
Approx Counter - Approximate token counter using the 4-characters ≈ 1-token heuristic.
Traits§
- Token
Counter - Trait for pluggable token counting backends.