Expand description
Streaming dataset for lazy/chunked data loading.
Provides StreamingDataset for working with datasets that are too large
to fit in memory, or when you want to start processing before the full
dataset is loaded.
Structs§
- Chained
Source - A data source that chains multiple sources together.
- Memory
Source - A data source backed by in-memory RecordBatches.
- Parquet
Source - A data source that reads from a Parquet file.
- Streaming
Dataset - A streaming dataset that loads data lazily in chunks.
Traits§
- Data
Source - A data source that can produce RecordBatches on demand.