Struct ContextCacheTracker 

pub struct ContextCacheTracker { /* private fields */ }

Per-session, per-model prefix overlap tracker.

The baseline is keyed by (session_id, provider, model). Changing the provider or model clears that key’s previous baseline so the first request after a switch reports a low (zero) prefix hit rate.

Implementations

impl ContextCacheTracker

pub fn new() -> Self

pub fn estimate( &mut self, session_id: Option<&str>, provider: &str, model: &str, context: &PiContext, ) -> PrefixHitEstimate

Compare context against the stored baseline for the active key, then store this context as the new baseline.

Call this immediately before sending the request, after all context transforms have been applied.

pub fn finalize( &self, estimate: &PrefixHitEstimate, total_input_tokens: u64, ) -> PrefixHitResult

Compute the token-level prefix estimate once the provider reports total input tokens for the request.

pub fn clear_session(&mut self, session_id: Option<&str>)

Drop all baselines for a session (e.g. session reset/clear).

Trait Implementations

impl Clone for ContextCacheTracker

fn clone(&self) -> ContextCacheTracker

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ContextCacheTracker

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ContextCacheTracker

fn default() -> ContextCacheTracker

Returns the “default value” for a type.