Expand description
Engine-agnostic paged-cache interface.
Every adapter (vLLM, SGLang, …) implements CachePager. The
SyntheticCachePager in this module is the in-process implementation
that lets the test suite (and the macOS build host) round-trip the cache
layer end-to-end without booting an inference engine.
Structs§
- Page
Bytes - One physical (K, V) page as a pair of opaque byte buffers, both of length
meta.page_bytes(). We never interpret the bytes — they’re whatever the engine handed us. - Synthetic
Cache Pager - In-memory
CachePagerused by every test in this crate and byexamples/02-twelve-way-parallel/(when that lands).
Traits§
- Cache
Pager - Engine-agnostic paged-cache interface. Implementations are not required
to be thread-safe for
read_page/write_page— the snapshot orchestrator holds a&mut selffor the duration of capture/restore.