Skip to main content

Module cache

Module cache 

Source
Expand description

LLM call cache

In-memory caching to reduce repeated LLM calls. Supports TTL (expiry) and a maximum-entry limit.

Re-exports§

pub use llm_cache::CacheConfig;
pub use llm_cache::CacheError;
pub use llm_cache::CachedLLMResult;
pub use llm_cache::LLMCache;

Modules§

llm_cache
LLM call cache implementation.