Expand description
Cache hint types for prompt caching across providers.
Context regions are assembled in order of volatility (most stable first). Cache breakpoints are inserted at region boundaries. Providers translate these breakpoints into their native caching APIs.
Enumsยง
- Cache
Hint - Cache hint for a region or message boundary.