Struct TokenBudget 

pub struct TokenBudget { /* private fields */ }

Thread-safe token budget tracker for LLM context windows.

Tracks total capacity, current usage, and provides atomic reserve/release operations for concurrent token accounting.

Implementations

impl TokenBudget

pub fn new(total: u32) -> Self

Create a new budget with the given total token capacity.

Initial usage is zero.

pub fn total(&self) -> u32

Returns the total token capacity.

pub fn remaining(&self) -> u32

Returns the number of remaining tokens.

pub fn used(&self) -> u32

Returns the number of currently used tokens.

pub fn try_reserve(&self, n: u32) -> bool

Try to reserve n tokens from the budget.

Returns true if the reservation succeeded (enough capacity remaining), false if there were insufficient tokens.

pub fn release(&self, n: u32)

Release n tokens back to the budget.

Clamps to zero — cannot release more than currently used.

pub fn reset(&self)

Reset the budget, setting used tokens back to zero.

Trait Implementations

impl Debug for TokenBudget

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.