Structs§
- Exact
Cache - A simple exact match cache.
- Semantic
Cache - A cache that uses semantic similarity to find matches. Useful when prompts are slightly different but intent is the same.
- Tiered
Cache - A hybrid cache that balances speed (exact) and flexibility (semantic).
Traits§
- Cache
- Trait for prompt caching strategies.