Skip to main content

Module parallel

Module parallel 

Source
Expand description

Parallel processing framework for CLI operations

Provides comprehensive parallel processing capabilities including:

  • Thread pool management and configuration
  • Parallel file processing with progress tracking
  • Work distribution across threads with load balancing
  • Progress aggregation across multiple operations
  • Error collection and handling
  • Resource management with memory limits
  • Batch operations with configurable sizes
  • Pipeline execution for chained operations

Structs§

BatchManager
Batch operation manager
ErrorCollector
Error collector for parallel operations
ErrorInfo
Error information with context
FnStage
Simple function-based pipeline stage
ParallelBandProcessor
Parallel band processor for multi-band raster operations
ParallelFileProcessor
Parallel file processor with advanced features
ParallelTileProcessor
Parallel tile processor for chunked raster operations
PipelineExecutor
Pipeline executor for chained operations
PipelineResult
Pipeline execution result
ProgressAggregator
Aggregated progress across multiple operations
ProgressStats
Progress statistics for a single operation
ResourceManager
Resource manager for parallel operations
ThreadPoolConfig
Thread pool configuration for parallel operations
WorkDistributor
Work distributor for parallel operations
WorkItem
Work item with priority and metadata

Enums§

DistributionStrategy
Work distribution strategy
ThreadPriority
Thread priority levels

Traits§

PipelineStage
Pipeline stage trait

Functions§

init_thread_pool
Initialize global thread pool with custom configuration
optimal_thread_count
Get optimal number of threads for current system
physical_core_count
Get optimal number of physical cores