Expand description
Response caching for intelligent behavior
This module provides a simple cache for LLM responses to improve performance and reduce API costs.
Structs§
- Response
Cache - Simple TTL-based cache for responses
Functions§
- generate_
cache_ key - Generate a cache key from method, path, and request body