Expand description
Prompt cache tracking and break detection.
Monitors cache hit/miss patterns across API calls to identify when the prompt cache is breaking and why. Tracks cache creation vs read tokens to compute effective cache utilization.
Structs§
- Cache
Tracker - Tracks cache performance across multiple API calls.
Enums§
- Cache
Event - Event produced by cache tracking for each API call.