Skip to main content

Module cache

Expand description

Response caching for intelligent behavior

This module provides a simple cache for LLM responses to improve performance and reduce API costs.

Structs§

ResponseCache
Simple TTL-based cache for responses

Functions§

generate_cache_key
Generate a cache key from method, path, and request body