Skip to main content

Module exchange

Module exchange 

Source
Expand description

Exchange / parallelization contract for RecordedUpdates.

ValPact is the PACT used when shuffling columnar updates across workers; ValDistributor is the per-worker partitioner it constructs.

Structsยง

ValDistributor
Distributor that routes RecordedUpdates records to workers by hashing keys.
ValPact
PACT for shuffling RecordedUpdates containers by hashing keys.