Struct AIUsage 

pub struct AIUsage {
    pub input: u64,
    pub output: u64,
    pub cache_read: u64,
}

A token tally for one request or a whole session.

Fields

input: u64

output: u64

cache_read: u64

Implementations

impl AIUsage

pub fn new(input: u64, output: u64) -> Self

pub fn cache_read(self, tokens: u64) -> Self

pub fn total(self) -> u64

Every token that passed through, for a context-window meter.

pub fn cost(self, pricing: AIPricing) -> f64

What this usage costs in dollars at these prices.

Trait Implementations

impl Add for AIUsage

Session totals are the sum of every request’s usage. Saturating rather than wrapping: a tally that silently rolls over to nearly zero is worse than one that sticks at the ceiling.

type Output = AIUsage

The resulting type after applying the + operator.

fn add(self, other: AIUsage) -> AIUsage

Performs the + operation.

impl Clone for AIUsage

fn clone(&self) -> AIUsage

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for AIUsage

impl Debug for AIUsage

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for AIUsage

fn default() -> AIUsage

Returns the “default value” for a type.

impl Eq for AIUsage

impl PartialEq for AIUsage

fn eq(&self, other: &AIUsage) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for AIUsage

impl Sum for AIUsage

fn sum<I: Iterator<Item = AIUsage>>(iter: I) -> AIUsage

Takes an iterator and generates Self from the elements by “summing up” the items.