Struct Usage 

pub struct Usage {
    pub input_tokens: u64,
    pub output_tokens: u64,
    pub cache_creation_input_tokens: u64,
    pub cache_read_input_tokens: u64,
}

What one turn cost: what the model read, split by where it came from, and what it wrote.

Fields

input_tokens: u64

output_tokens: u64

cache_creation_input_tokens: u64

cache_read_input_tokens: u64

Implementations

impl Usage

pub fn input(&self) -> u64

Everything the model was sent for this turn, which is the conversation as it stood. The transcript splits it by where it was served from (fresh, cached this turn, replayed from an earlier one), a billing distinction rather than anything about the conversation, so this recombines it.

pub fn uncached_input(&self) -> u64

The part of that input the model had not been sent before: what this turn added to the conversation, which is what the turn’s own output can be read against. The cache holds exactly the prefix already sent, so its boundary marks what is new, except where a lapsed cache re-sends a prefix and counts it new again.

Trait Implementations

impl Clone for Usage

fn clone(&self) -> Usage

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for Usage

impl Debug for Usage

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Usage

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for Usage

impl PartialEq for Usage

fn eq(&self, other: &Usage) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Usage