Trait TokenCounter 

pub trait TokenCounter: WasmCompatSend + WasmCompatSync {
    // Required method
    fn count(&self, message: &Message) -> usize;
}

Counts the tokens contributed by a single Message.

Implementors should pick a counting strategy appropriate for their target provider (for example, tiktoken-rs for OpenAI). Counting must be cheap; it runs once per message on every memory load.

Required Methods

fn count(&self, message: &Message) -> usize

Approximate the number of tokens contributed by message.

Trait Implementations

impl TokenCounter for Box<dyn TokenCounter>

fn count(&self, message: &Message) -> usize

Approximate the number of tokens contributed by message.

Implementations on Foreign Types

impl TokenCounter for Box<dyn TokenCounter>

fn count(&self, message: &Message) -> usize

impl<C> TokenCounter for Arc<C>

where C: TokenCounter + ?Sized,

fn count(&self, message: &Message) -> usize

Implementors

impl TokenCounter for HeuristicTokenCounter

impl<F> TokenCounter for F

where F: Fn(&Message) -> usize + WasmCompatSend + WasmCompatSync,