Expand description
Out-of-core processing for large datasets Out-of-core processing for large datasets
This module provides utilities for processing datasets that are too large to fit in memory, using chunked processing and memory-mapped files.
Structs§
- Chunked
Array Iterator - Iterator over chunks of array data
- Chunked
Array Reader - Reader for chunked array data from disk
- Chunked
Array Writer - Writer for chunked array data to disk
- OutOf
Core Config - Configuration for out-of-core processing
- OutOf
Core Normalizer - Out-of-core normalizer implementation
Traits§
- OutOf
Core Transformer - Trait for transformers that support out-of-core processing
Functions§
- csv_
chunks - Create chunks from a large CSV file