Module streaming

Module streaming 

Source
Expand description

Streaming support for large datasets

This module provides comprehensive streaming capabilities for handling datasets that are too large to fit in memory, enabling processing of massive datasets in a memory-efficient manner.

Structs§

DataChunk
A chunk of data from a streaming dataset
StreamConfig
Configuration for streaming operations
StreamProcessor
Parallel streaming processor for applying operations to chunks
StreamStats
Statistics about streaming operation
StreamTransformer
Memory-efficient data transformer for streaming
StreamingIterator
Iterator over streaming dataset chunks

Functions§

stream_classification
Stream synthetic classification data
stream_csv
Convenience functions for common streaming operations
stream_regression
Stream synthetic regression data