Struct CacheMetrics 

pub struct CacheMetrics {
    pub total_requests: u32,
    pub requests_with_cache_hits: u32,
    pub total_prompt_tokens: i64,
    pub total_cache_read_tokens: i64,
    pub total_cache_creation_tokens: i64,
    pub cache_hit_ratio: f64,
    pub cache_utilization_ratio: f64,
    pub avg_cached_tokens_per_request: f64,
}

Available on crate feature runner only.

Metrics computed from session event history.

All ratio fields are percentages in the range [0.0, 100.0]. When there are no events with usage metadata, all fields are zero.

Example

use adk_runner::CachePerformanceAnalyzer;

let events = session.events();
let metrics = CachePerformanceAnalyzer::analyze(&events);
println!("Cache hit ratio: {:.1}%", metrics.cache_hit_ratio);

Fields

total_requests: u32

Total requests with UsageMetadata.

requests_with_cache_hits: u32

Requests where cache_read_input_token_count > 0.

total_prompt_tokens: i64

Sum of all prompt_token_count values.

total_cache_read_tokens: i64

Sum of all cache_read_input_token_count values.

total_cache_creation_tokens: i64

Sum of all cache_creation_input_token_count values.

cache_hit_ratio: f64

total_cache_read_tokens / total_prompt_tokens * 100.

cache_utilization_ratio: f64

requests_with_cache_hits / total_requests * 100.

avg_cached_tokens_per_request: f64

total_cache_read_tokens / total_requests.

Trait Implementations

impl Clone for CacheMetrics

fn clone(&self) -> CacheMetrics

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CacheMetrics

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for CacheMetrics

fn default() -> CacheMetrics

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for CacheMetrics

fn deserialize<__D>( __deserializer: __D, ) -> Result<CacheMetrics, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for CacheMetrics

fn serialize<__S>( &self, __serializer: __S, ) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.