Struct TokenUsage 

pub struct TokenUsage {
    pub input_tokens: u32,
    pub output_tokens: u32,
    pub cache_read_input_tokens: u32,
    pub cache_creation_input_tokens: u32,
}

Token consumption for a single LLM call.

Fields

input_tokens: u32

Full prompt size: uncached input + cache reads + cache writes.

output_tokens: u32

cache_read_input_tokens: u32

Prompt tokens served from cache (billed ~0.1x). Subset of input_tokens.

cache_creation_input_tokens: u32

Prompt tokens written to cache (billed ~1.25x). Subset of input_tokens.

Implementations

impl TokenUsage

pub fn total_tokens(&self) -> u32

Trait Implementations

impl Clone for TokenUsage

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenUsage

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for TokenUsage

fn default() -> Self

Returns the “default value” for a type.