Module parallel_preprocessing 

Parallel data preprocessing

Multi-threaded preprocessing pipeline with work-stealing scheduler and backpressure handling for optimal throughput. Parallel data preprocessing pipeline

This module provides a multi-threaded preprocessing pipeline with work-stealing scheduler, memory-efficient batch processing, and backpressure handling for optimal throughput and resource utilization.

Structs

ParallelConfig

Configuration for parallel preprocessing

ParallelPipeline

Parallel preprocessing pipeline

Functions

create_pipeline

Create a simple preprocessing pipeline

create_pipeline_with_config

Create a pipeline with custom configuration

Type Aliases

PreprocessFn

Preprocessing function type