Struct llm_chain::tokens::TokenCount

pub struct TokenCount { /* private fields */ }

Struct representing token count information, including the maximum tokens allowed and the total number of tokens used.

Implementations

impl TokenCount

pub fn new(max_tokens: i32, tokens_used: i32, template_tokens_used: i32) -> Self

Creates a new TokenCount instance with the given maximum tokens and tokens used.

Arguments

• max_tokens - The maximum number of tokens allowed.
• tokens_used - The total number of tokens used.

pub fn has_tokens_remaining(&self) -> bool

Returns true if there is still room in the context window.

pub fn has_room_for(&self, tokens: i32) -> bool

Returns true if there is room for the given number of tokens.

Arguments

• tokens - The number of tokens to check if there is room for.

Examples

use llm_chain::tokens::TokenCount;
let token_count = TokenCount::new(100, 50, 10);
assert!(token_count.has_room_for(49));