Expand description
Bounded execution contracts for streaming and out-of-core work.
Producers are pulled one batch at a time. Each pull carries explicit row and byte demand, while retained memory is charged to a shared budget through an RAII reservation. This keeps live workspace proportional to concurrent batch demand rather than total input size. Cancellation and storage policy travel in the same cheap-to-clone context.
Structs§
- Batch
Buffer Pool - One-slot pool that keeps a reusable batch and its memory charge together.
- Batch
Demand - Maximum work a consumer is prepared to accept from one pull.
- Batch
Lease - A batch whose retained bytes are charged to an execution context.
- Cancellation
Token - A cheap, thread-safe cooperative cancellation handle.
- Cancelled
- An execution stopped after cooperative cancellation was requested.
- Execution
Context - Shared controls passed through every stage of an out-of-core operation.
- Execution
Context Builder - Declarative construction of an
ExecutionContext. - Memory
Budget - A validated upper bound for memory retained by one execution context.
- Memory
Reservation - Exclusive accounting for bytes retained by an operation.
- Retained
- An owned result retaining the reservation for its backing allocations.
- Scratch
Policy - Upper bound for reusable in-memory scratch owned by one stage.
- Spill
Artifact - Immutable temporary records deleted when the artifact is dropped.
- Spill
File - Append-only temporary file charged to one execution context.
- Spill
Reader - Sequential reader that reuses caller-owned payload capacity.
Enums§
- Backpressure
- Outcome of one non-blocking batch pull.
- Context
Error - Inconsistent execution policies supplied to a context builder.
- Memory
Budget Error - Failure to construct or reserve an execution-memory budget.
- Spill
Error - Failure to create, write, or validate bounded temporary storage.
- Temp
Storage Policy - Policy controlling whether and where execution may spill temporary data.
Constants§
- DEFAULT_
MEMORY_ BUDGET_ BYTES - Default upper bound for retained execution workspace: 100 MB.
Traits§
- Batch
- A bounded unit of columnar or row-oriented work.
- Batch
Source - A pull source whose live workspace is governed by an
ExecutionContext.