Expand description
Pluggable token counting for context budget management.
Provides the TokenCounter trait for text-to-token-count conversion,
with EstimateTokenCounter as a simple default.
Structs§
- Estimate
Token Counter - Default token counter: estimates tokens as
len / 4.
Traits§
- Token
Counter - Trait for counting tokens in text.