Expand description
LLM call cache
In-memory caching to reduce repeated LLM calls. Supports TTL (expiry) and a maximum-entry limit.
Re-exports§
pub use llm_cache::CacheConfig;pub use llm_cache::CacheError;pub use llm_cache::CachedLLMResult;pub use llm_cache::LLMCache;
Modules§
- llm_
cache - LLM call cache implementation.