Struct CacheUsage 

pub struct CacheUsage {
    pub cache_read_input_tokens: u32,
    pub cache_creation_input_tokens: u32,
    pub input_tokens: u32,
    pub output_tokens: u32,
}

Prompt-cache accounting returned by the provider after a request. Used for telemetry (llm_cache_read_tokens_total, hit-ratio gauge) and to make billing predictable in dashboards.

Field semantics (Anthropic-aligned, generalized):

• cache_read_input_tokens — tokens served from cache at 0.1× cost.
• cache_creation_input_tokens — tokens written to cache at 1.25× (5min) or 2× (1h) cost on this turn.
• input_tokens — uncached input tokens billed at base rate.
• output_tokens — completion tokens (mirrors TokenUsage for provider clients that fill both atomically).

Fields

cache_read_input_tokens: u32

cache_creation_input_tokens: u32

input_tokens: u32

output_tokens: u32

Implementations

impl CacheUsage

pub fn hit_ratio(&self) -> f32

Cache hit ratio for this turn: read / (read + creation + uncached_input). Returns 0.0 when no input tokens were billed.

Trait Implementations

impl Clone for CacheUsage

fn clone(&self) -> CacheUsage

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CacheUsage

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CacheUsage

fn default() -> CacheUsage

Returns the “default value” for a type.

impl PartialEq for CacheUsage

fn eq(&self, other: &CacheUsage) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for CacheUsage

impl StructuralPartialEq for CacheUsage