Skip to main content

Module pager

Module pager 

Source
Expand description

Engine-agnostic paged-cache interface.

Every adapter (vLLM, SGLang, …) implements CachePager. The SyntheticCachePager in this module is the in-process implementation that lets the test suite (and the macOS build host) round-trip the cache layer end-to-end without booting an inference engine.

Structs§

PageBytes
One physical (K, V) page as a pair of opaque byte buffers, both of length meta.page_bytes(). We never interpret the bytes — they’re whatever the engine handed us.
SyntheticCachePager
In-memory CachePager used by every test in this crate and by examples/02-twelve-way-parallel/ (when that lands).

Traits§

CachePager
Engine-agnostic paged-cache interface. Implementations are not required to be thread-safe for read_page / write_page — the snapshot orchestrator holds a &mut self for the duration of capture/restore.