Skip to main content

run_pipeline

Function run_pipeline 

Source
pub fn run_pipeline<T, P>(
    pipeline: &mut P,
    source: impl Iterator<Item = Result<T>>,
    chunk_size: usize,
) -> Result<RunStats>
where P: StreamingPipeline<T>,
Expand description

Drive pipeline by reading from source in chunks of chunk_size items.

Returns RunStats on success. The iterator’s item errors are propagated unless RunOptions::skip_errors is set.

§Arguments