Struct StreamingCsvProcessor 

pub struct StreamingCsvProcessor { /* private fields */ }

Streaming CSV processor that visits rows one at a time without materializing the full DataFrame. Memory usage is O(ncols).

Implementations

impl StreamingCsvProcessor

pub fn new(config: CsvConfig) -> Self

Create a new streaming CSV processor.

pub fn sum_columns( &self, input: &[u8], ) -> Result<(Vec<String>, Vec<f64>, usize), DataError>

Stream through CSV, accumulating per-column sums using Kahan summation.

Returns (column_names, sums_per_col, row_count).

pub fn minmax_columns( &self, input: &[u8], ) -> Result<(Vec<String>, Vec<f64>, Vec<f64>, usize), DataError>

Stream through CSV, collecting per-column min/max without materializing.

Returns (column_names, mins, maxs, row_count).