Skip to main content

Module streaming

Module streaming 

Source
Expand description

Streaming utilities for processing large database result sets

Structs§

StreamingConfig
Configuration for streaming database results
StreamingProgress
Progress tracking for streaming operations

Functions§

apply_sampling_if_needed
Sample large datasets to fit within memory constraints
estimate_memory_usage
Calculate memory usage of column data (rough estimate)
merge_column_batches
Utility to merge multiple batches of column data