tenshift-core 0.1.3

Thread-safe, backpressure-aware data loading pipeline for iterative processing
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12

//! Collector-stage orchestration for the tenshift pipeline.
//!
//! The collector is the ordered half of the architecture: it receives worker
//! output, applies shuffle and batch stages, performs collation, and emits the
//! final batches that the iterator exposes to callers.

#![allow(clippy::module_name_repetitions)]

mod accumulate;
mod flush;

pub(crate) use flush::*;