pub fn run_pipeline<T, P>(
pipeline: &mut P,
source: impl Iterator<Item = Result<T>>,
chunk_size: usize,
) -> Result<RunStats>where
P: StreamingPipeline<T>,Expand description
Drive pipeline by reading from source in chunks of chunk_size items.
Returns RunStats on success. The iterator’s item errors are propagated
unless RunOptions::skip_errors is set.
§Arguments
pipeline– A mutable reference to aStreamingPipeline.source– Any iterator whose items areResult<T>.chunk_size– Number of items to accumulate before callingStreamingPipeline::process_chunk. Must be ≥ 1.