Expand description
Streaming data preprocessing for large datasets
This module provides comprehensive streaming preprocessing capabilities for processing datasets that don’t fit in memory by processing them in chunks. All transformers support incremental fitting and transformation with advanced memory management, parallel processing, and adaptive algorithms. All algorithms have been refactored into focused modules for better maintainability and comply with SciRS2 Policy.
Structs§
- Adaptive
Config - Placeholder AdaptiveConfig
- Adaptive
Parameter Manager - Placeholder AdaptiveParameterManager
- Adaptive
Streaming MinMax Scaler - Placeholder AdaptiveStreamingMinMaxScaler
- Adaptive
Streaming Standard Scaler - Placeholder AdaptiveStreamingStandardScaler
- IncrementalPCA
- Placeholder IncrementalPCA
- IncrementalPCA
Stats - Placeholder IncrementalPCAStats
- Mini
Batch Config - Placeholder MiniBatchConfig
- Mini
Batch Iterator - Placeholder MiniBatchIterator
- Mini
Batch Pipeline - Placeholder MiniBatchPipeline
- Mini
Batch Stats - Placeholder MiniBatchStats
- Mini
Batch Streaming Transformer - Placeholder MiniBatchStreamingTransformer
- Multi
Quantile Estimator - Placeholder MultiQuantileEstimator
- OnlineMAD
Estimator - Placeholder OnlineMADEstimator
- OnlineMAD
Stats - Placeholder OnlineMADStats
- Online
Quantile Estimator - Placeholder OnlineQuantileEstimator
- Online
Quantile Stats - Placeholder OnlineQuantileStats
- Parameter
Update - Parameter update record
- Stream
Characteristics - Stream characteristics
- Streaming
Config - Streaming configuration
- Streaming
Label Encoder - Placeholder StreamingLabelEncoder
- Streaming
MinMax Scaler - Placeholder StreamingMinMaxScaler
- Streaming
Pipeline - Placeholder StreamingPipeline
- Streaming
Robust Scaler - Placeholder StreamingRobustScaler
- Streaming
Robust Scaler Stats - Placeholder StreamingRobustScalerStats
- Streaming
Simple Imputer - Placeholder StreamingSimpleImputer
- Streaming
Standard Scaler - Placeholder StreamingStandardScaler
- Streaming
Stats - Placeholder StreamingStats
Traits§
- Mini
Batch Transformer - Placeholder MiniBatchTransformer trait
- Streaming
Transformer - Placeholder StreamingTransformer trait