Struct CacheStats 

pub struct CacheStats {
    pub input_tokens: u64,
    pub output_tokens: u64,
    pub cache_read_tokens: u64,
    pub cache_creation_tokens: u64,
}

Statistics about cache usage from an API response.

Anthropic returns cache statistics in the usage field of responses:

• cache_read_input_tokens: Tokens served from cache (90% cheaper)
• cache_creation_input_tokens: Tokens used to create the cache

Cost Model

• Normal input tokens: $0.003 per 1K tokens
• Cached input tokens: $0.0003 per 1K tokens (90% discount)
• Cache creation has a small overhead but pays off after 2-3 uses

Example

use edgequake_llm::cache_prompt::CacheStats;

let stats = CacheStats {
    input_tokens: 10000,
    output_tokens: 1000,
    cache_read_tokens: 8000,
    cache_creation_tokens: 0,
};

println!("Cache hit rate: {:.0}%", stats.cache_hit_rate() * 100.0);
println!("Estimated savings: ${:.4}", stats.savings());

Fields

input_tokens: u64

Total input tokens in the request.

output_tokens: u64

Total output tokens in the response.

cache_read_tokens: u64

Input tokens served from cache.

cache_creation_tokens: u64

Tokens used to create new cache entries.

Implementations

impl CacheStats

pub fn new( input_tokens: u64, output_tokens: u64, cache_read_tokens: u64, cache_creation_tokens: u64, ) -> Self

Create new cache stats.

pub fn cache_hit_rate(&self) -> f64

Calculate the cache hit rate as a fraction (0.0 to 1.0).

Returns 0.0 if there are no input tokens.

pub fn savings(&self) -> f64

Estimate cost savings in dollars.

Based on Anthropic Claude pricing (as of 2024):

• Normal input: $0.003 per 1K tokens
• Cached input: $0.0003 per 1K tokens

Returns the difference between what would have been paid without caching vs with caching.

pub fn cost_per_call(&self) -> f64

Calculate the cost per call with current cache stats.

pub fn is_effective(&self) -> bool

Check if caching was effective (hit rate > 50%).

pub fn merge(&mut self, other: &CacheStats)

Merge stats from another request.

Trait Implementations

impl Clone for CacheStats

fn clone(&self) -> CacheStats

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CacheStats

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CacheStats

fn default() -> CacheStats

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for CacheStats

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for CacheStats

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.