Expand description
LLM response cache for Pulse narration
Caches LLM-generated summaries keyed by structural context hash. Same structural inputs → cache hit, regardless of LLM provider or model.
Structs§
- Cached
Response - A cached LLM response
- LlmCache
- LLM response cache manager