Structs§
- Cache
Boundary - A detected prompt cache boundary in a message sequence.
- Message
- A single message in a conversation, used for cache boundary detection.
- Prompt
Cache Detector - Detects prompt cache boundaries for Anthropic and OpenAI API formats.