Skip to main content

Module spill

Module spill 

Source
Expand description

Traits for paging chunks of merge-batcher state to and from backing storage.

Modeled on timely’s pager traits in timely-dataflow/communication/src/allocator/zero_copy/spill.rs (SpillPolicy, BytesSpill, BytesFetch), but parameterized over a chunk type C rather than fixed to timely::bytes::arc::Bytes. For the columnar batcher we expect C = Updates<U>; that wiring lives elsewhere — this file only defines the trait shapes.

Enums§

Entry
A queue entry: either an in-memory chunk or a handle that can fetch one (or several) from backing storage.

Traits§

Fetch
Handle to spilled chunk(s). Consume to retrieve them from storage.
Spill
Move in-memory chunks to backing storage, returning fetch handles.
SpillPolicy
Decides which queue entries to spill out and which to keep resident.