Struct CachedResponse 

pub struct CachedResponse {
    pub response: String,
    pub prompt: String,
    pub similarity: f32,
    pub created_at: Instant,
    pub hit_count: u64,
}

A cached LLM response returned on a semantic cache hit.

Fields

response: String

The cached response text.

prompt: String

The original prompt that produced this response.

similarity: f32

Cosine similarity between the lookup query and the stored prompt.

created_at: Instant

When this cache entry was created.

hit_count: u64

How many times this entry has been returned as a cache hit.

Implementations

impl CachedResponse

pub fn is_expired(&self, ttl: Duration) -> bool

Returns true if this entry is older than ttl.

pub fn age(&self) -> Duration

Time elapsed since this entry was created.

Trait Implementations

impl Clone for CachedResponse

fn clone(&self) -> CachedResponse

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CachedResponse

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.