Expand description
Embeddable KV-cache store API for inference engines.
Combines the in-process FoyerHybridCache
(G2 RAM + G3 NVMe) with a durable object store (G4: S3, MinIO,
local fs via wombatkv_store::wal_store::InMemoryObjectStore for tests) so
a single inference engine can:
- Write a KV blob through both tiers (foyer hot, S3 cold) on prefill.
- Read with foyer-first, S3-fallback semantics on decode / cold start.
- Restart cleanly: a fresh process can rehydrate foyer from S3 on boot, so no work is lost when the engine restarts.
The store is generic over wombatkv_store::wal_store::ObjectStore, so the
same code path is exercised by unit tests (in-memory) and by live
MinIO/S3 integration tests.
Structs§
- Embed
Config - Tuning knobs for the embeddable KV store.
- WombatKV
KvStore - Embeddable KV cache store.
Enums§
- Embed
Error - Errors surfaced by the embeddable KV store.
- GetOutcome
- Outcome of a
get_kvcall. - HitTier
- A KV cache lookup hit, with the tier the value came from.