Struct RequestGapTracker 

pub struct RequestGapTracker { /* private fields */ }

Tracks the wall-clock time of the most recently dispatched LLM request.

Implementations

impl RequestGapTracker

pub fn note_request_sent(&mut self)

Records that an LLM request was just dispatched, so the next call to Self::cache_gap_exceeds can measure the idle gap since this request.

pub fn cache_gap_exceeds(&self, threshold: Duration) -> Option<Duration>

Returns the elapsed time since the last dispatched request when it exceeds threshold, or None if there was no prior request or the gap is still within the threshold. Used to warn that the provider prompt cache has likely expired before the next request re-pays full input cost.

pub fn has_sent_request(&self) -> bool

Returns whether an LLM request has been dispatched at any point this session. More precise than inferring from accumulated token usage (which can be zero even after a request, e.g. an error response).

Trait Implementations

impl Clone for RequestGapTracker

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for RequestGapTracker

impl Debug for RequestGapTracker

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for RequestGapTracker

fn default() -> Self

Returns the “default value” for a type.