pub trait TokenMeter: Send + Sync {
// Required method
fn count(&self, model: &str, messages: &[ChatMessage]) -> u64;
}Expand description
Token estimator used for limits and compaction decisions.
Required Methods§
Sourcefn count(&self, model: &str, messages: &[ChatMessage]) -> u64
fn count(&self, model: &str, messages: &[ChatMessage]) -> u64
Estimated prompt tokens for messages under model.
Dyn Compatibility§
This trait is dyn compatible.
In older versions of Rust, dyn compatibility was called "object safety".