Module pipeline

Module pipeline 

Source
Expand description

Advanced Pipeline Features for Preprocessing Transformations

This module provides sophisticated pipeline capabilities including:

  • Conditional preprocessing steps
  • Parallel preprocessing branches
  • Caching for expensive transformations
  • Dynamic pipeline construction
  • Error handling and recovery strategies

Structs§

AdvancedPipeline
Advanced pipeline with caching and conditional steps
AdvancedPipelineBuilder
Builder for creating advanced pipelines
AdvancedPipelineConfig
Configuration for advanced pipeline
CacheConfig
Configuration for caching behavior
CacheStats
Cache statistics
ConditionalStep
A conditional preprocessing step
ConditionalStepConfig
Configuration for conditional preprocessing step
DynamicPipeline
Dynamic pipeline that can be modified at runtime
ParallelBranchConfig
Configuration for parallel preprocessing branches
ParallelBranches
Parallel preprocessing branches
StreamingTransformerWrapper
Wrapper for streaming transformers to work in regular pipelines
TransformationCache
Thread-safe cache for transformation results

Enums§

BranchCombinationStrategy
Strategy for combining parallel branch results
ErrorHandlingStrategy
Error handling strategy for pipeline execution
PipelineStep
Pipeline step that can be conditional, parallel, cached, or streaming

Type Aliases§

ConditionFn
Condition function type for conditional preprocessing