Skip to main content

TokenMeter

af_agent_runtime

Trait TokenMeter 

Source 
pub trait TokenMeter: Send + Sync {
    // Required method
    fn count(&self, model: &str, messages: &[ChatMessage]) -> u64;
}

Required Methods§

Source

fn count(&self, model: &str, messages: &[ChatMessage]) -> u64

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§