Trait TokenCounter 

pub trait TokenCounter: WasmCompatSend + WasmCompatSync {
    // Required method
    fn count(&self, message: &Message) -> usize;
}

Counts the tokens contributed by a single Message.

Implementors should pick a counting strategy appropriate for their target provider (for example, tiktoken-rs for OpenAI). Counting must be cheap; it runs once per message on every memory load.

Required Methods

fn count(&self, message: &Message) -> usize

Approximate the number of tokens contributed by message.

Trait Implementations

impl TokenCounter for Box<dyn TokenCounter>

fn count(&self, message: &Message) -> usize

Approximate the number of tokens contributed by message.

Dyn Compatibility

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementations on Foreign Types

impl TokenCounter for Box<dyn TokenCounter>

fn count(&self, message: &Message) -> usize

impl<C> TokenCounter for Arc<C>

where C: TokenCounter + ?Sized,

fn count(&self, message: &Message) -> usize

Implementors

impl TokenCounter for HeuristicTokenCounter

impl<F> TokenCounter for F

where F: Fn(&Message) -> usize + WasmCompatSend + WasmCompatSync,