Struct TiktokenManager 

pub struct TiktokenManager { /* private fields */ }

Manages cached tiktoken BPE instances for different encodings.

Thread-safe and lazily initialized - encodings are only loaded when first used.

Implementations

impl TiktokenManager

pub fn new() -> Self

Create a new tiktoken manager

pub fn encoding_for_model(&self, model: &str) -> TiktokenEncoding

Get the appropriate encoding for a model name

pub fn count_tokens(&self, _model: Option<&str>, text: &str) -> u64

pub fn count_tokens_with_encoding( &self, _encoding: TiktokenEncoding, text: &str, ) -> u64

pub fn count_chat_request(&self, body: &[u8], model: Option<&str>) -> u64

Count tokens in a chat completion request body

Parses the JSON and extracts message content for accurate token counting. Returns estimated tokens including overhead for message formatting.

pub fn is_available(&self) -> bool

Check if tiktoken is available (feature enabled)

Trait Implementations

impl Default for TiktokenManager

fn default() -> Self

Returns the “default value” for a type.