Struct ChunkOffsets 

pub struct ChunkOffsets {
    pub rid_offset: usize,
    pub master_local: Vec<usize>,
    pub hn_master_counter: u64,
    pub id_local: Vec<usize>,
}

Carries the running counters that record_id/master_id generation depend on across a sequence of chunked runs (--chunk-size), so chunk N+1 continues exactly where chunk N left off instead of restarting at 0 — genuinely contiguous, global identifiers over the whole logical dataset, with no shard-tag hack needed on top. Defaults (all zero) give the single-run behavior, unchanged.

Fields

rid_offset: usize

Next record_id index to hand out (see record_id_string).

master_local: Vec<usize>

Next local master_id index per entity, indexed by the entity’s position in PipelineConfig::entity_plans (see entity_prefix). Entities absent from a shorter previous chunk’s plan (shouldn’t happen — the same schema/--only-entity produces the same plan shape every chunk) simply default to 0 via master_base.

hn_master_counter: u64

Next HN-{:09} counter value (see hn_master_id_counter).

id_local: Vec<usize>

Next row_offset per entity (same indexing as master_local) for the generated _id columns (column_gen’s PREFIX-0000000042 fallback): past this entity’s base rows and its canary rows of every previous chunk. Without it each chunk numbered its _ids from 0 again, so two unrelated records of different chunks shared one party_id/customer_id.

Trait Implementations

impl Clone for ChunkOffsets

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ChunkOffsets

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ChunkOffsets

fn default() -> Self

Returns the “default value” for a type.