Skip to main content

save_streaming

alimentar::format::streaming

Function save_streaming 

Source 
pub fn save_streaming<P, I>(
    batches: I,
    schema: &SchemaRef,
    path: P,
    chunk_size: Option<usize>,
    compression: Compression,
) -> Result<()>
where
    P: AsRef<Path>,
    I: Iterator<Item = RecordBatch>,
Expand description

Save a dataset in streaming format

§Arguments

  • batches - Iterator of record batches to save
  • schema - Arrow schema
  • path - Output file path
  • chunk_size - Rows per chunk (default: 65536)
  • compression - Compression type to use

§Errors

Returns error if file cannot be written.