Struct TokenPool 

pub struct TokenPool {
    pub name: String,
    pub capacity: u64,
    pub used: u64,
    pub reserved: u64,
}

A named token pool with a capacity limit.

Fields

name: String

Pool name (e.g. “default”, “agent-123”, “batch-jobs”).

capacity: u64

Maximum tokens allowed in this pool.

used: u64

Tokens consumed so far.

reserved: u64

Tokens currently reserved (pending completion).

Implementations

impl TokenPool

pub fn new(name: impl Into<String>, capacity: u64) -> Self

Create a new pool with the given capacity.

pub fn available(&self) -> u64

Available tokens (capacity - used - reserved).

pub fn can_reserve(&self, tokens: u64) -> bool

Whether the pool can accommodate tokens more.

pub fn reserve(&mut self, tokens: u64) -> bool

Reserve tokens (before inference).

pub fn commit(&mut self, reserved: u64, actual: u64)

Commit reserved tokens as used (after inference completes).

pub fn release(&mut self, tokens: u64)

Release reserved tokens without using them (on failure/cancel).

pub fn utilization(&self) -> f64

Utilisation ratio (0.0–1.0).

Trait Implementations

impl Clone for TokenPool

fn clone(&self) -> TokenPool

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenPool

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for TokenPool

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for TokenPool

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.