Module llm_cache 

LLM call cache implementation.

In-memory LRU cache that memoizes repeated LLM call results. Supports optional TTL expiry and a maximum-entry limit.

Structs

CacheConfig

Cache configuration

CachedLLMResult

Cached LLM result, with its expiry time

LLMCache

LLM call cache

Enums

CacheError

Error type for the LLM cache.