Expand description
L1 exact-match cache. L1 exact-match cache (in-memory).
L1 uses a BLAKE3 hash of the prompt (plus tenant prefix) as the key and stores an
crate::storage::mmap::MmapFileHandle to the persisted entry payload.
Structsยง
- L1Cache
- In-memory exact-match cache keyed by prompt hash.
- L1Cache
Handle - Shared handle to an
L1Cache. - L1Lookup
Result - Result of an L1 lookup (exact hash match).