Skip to main content

Module state

Module state 

Source
Expand description

Durable progress marker for faucet backfill — one JSON document per backfill range at {name}::__backfill__::{range_hash} in the pipeline’s state store, recording each unit’s terminal outcome so --resume re-runs only failed/pending units. Kept separate from every live bookmark key ({name}::{row}) and every unit’s scoped key ({name}::backfill::{unit}).

Structs§

BackfillState
The durable backfill marker.

Enums§

UnitOutcome
Terminal outcome of one unit.

Functions§

marker_key
State key holding a range’s progress marker.
split_remaining
Split the plan into (to-run, already-done) against a loaded marker: done units are skipped, failed and pending units run. A fresh marker runs everything.
unit_row_id
The synthesized row id for a unit’s node.
unit_state_key
State key a unit’s pipeline invocation reads/advances — the executor’s key for a root node whose id is backfill::{unit} (namespaced away from the live {name}::{row} key, so the forward sync’s bookmark is never touched).