Module response_cache 

Bounded in-memory cache for identical model responses.

Structs

CacheStats

Snapshot of cache activity.

CachedResponse

A response stored in the cache.

ResponseCache

Thread-safe bounded LRU response cache.

ResponseCacheKey

Stable cache key derived from response-defining request fields.

Enums

CachePolicy

Selects how cached responses determine their lifetime.

Constants

DEFAULT_TTL

Default lifetime for a cached response.

MAX_ENTRIES

Maximum number of responses retained by a response cache.