Expand description
Streaming iterator API for datasets exceeding RAM.
Provides a lazy, chunk-based iteration interface over multiple data sources
(in-memory vectors, CSV files, directories of files). Each iteration step
yields a StreamingDataChunk holding at most chunk_size rows, enabling
processing of arbitrarily large datasets with bounded memory usage.
Structs§
- NewStreaming
Iterator - Streaming iterator over a
DataSource, yieldingStreamingDataChunks. - Streaming
Data Chunk - A single chunk produced by
NewStreamingIterator. - Streaming
Iterator Config - Configuration for a
NewStreamingIterator.
Enums§
- Data
Source - Origin of data for a
NewStreamingIterator.