Skip to main content

Module cache_tracking

Module cache_tracking 

Source
Expand description

Prompt cache tracking and break detection.

Monitors cache hit/miss patterns across API calls to identify when the prompt cache is breaking and why. Tracks cache creation vs read tokens to compute effective cache utilization.

Structs§

CacheTracker
Tracks cache performance across multiple API calls.

Enums§

CacheEvent
Event produced by cache tracking for each API call.