pub struct CacheMetrics {
pub total_requests: u32,
pub requests_with_cache_hits: u32,
pub total_prompt_tokens: i64,
pub total_cache_read_tokens: i64,
pub total_cache_creation_tokens: i64,
pub cache_hit_ratio: f64,
pub cache_utilization_ratio: f64,
pub avg_cached_tokens_per_request: f64,
}Expand description
Metrics computed from session event history.
All ratio fields are percentages in the range [0.0, 100.0].
When there are no events with usage metadata, all fields are zero.
§Example
ⓘ
use adk_runner::CachePerformanceAnalyzer;
let events = session.events();
let metrics = CachePerformanceAnalyzer::analyze(&events);
println!("Cache hit ratio: {:.1}%", metrics.cache_hit_ratio);Fields§
§total_requests: u32Total requests with UsageMetadata.
requests_with_cache_hits: u32Requests where cache_read_input_token_count > 0.
total_prompt_tokens: i64Sum of all prompt_token_count values.
total_cache_read_tokens: i64Sum of all cache_read_input_token_count values.
total_cache_creation_tokens: i64Sum of all cache_creation_input_token_count values.
cache_hit_ratio: f64total_cache_read_tokens / total_prompt_tokens * 100.
cache_utilization_ratio: f64requests_with_cache_hits / total_requests * 100.
avg_cached_tokens_per_request: f64total_cache_read_tokens / total_requests.
Trait Implementations§
Source§impl Clone for CacheMetrics
impl Clone for CacheMetrics
Source§fn clone(&self) -> CacheMetrics
fn clone(&self) -> CacheMetrics
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for CacheMetrics
impl Debug for CacheMetrics
Source§impl Default for CacheMetrics
impl Default for CacheMetrics
Source§fn default() -> CacheMetrics
fn default() -> CacheMetrics
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for CacheMetrics
impl<'de> Deserialize<'de> for CacheMetrics
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for CacheMetrics
impl RefUnwindSafe for CacheMetrics
impl Send for CacheMetrics
impl Sync for CacheMetrics
impl Unpin for CacheMetrics
impl UnsafeUnpin for CacheMetrics
impl UnwindSafe for CacheMetrics
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more