Skip to main content

Module proxy_cache_attribution

Module proxy_cache_attribution 

Source
Expand description

Prompt-cache miss attribution counters (#986): the proxy classifies each anchored turn (proxy::cache_attribution) and counts the outcome here; the proxy’s /status and the MCP server’s metrics read the cumulative gauges.

Structs§

CacheAttribution
Point-in-time view of the miss-attribution counters for /status.

Enums§

CacheOutcome
The cache outcome attributed to one anchored (cached > 0) request, by comparing its cacheable prefix + idle time against the previous turn.

Functions§

record_outcome
Count one attributed outcome.
snapshot