Struct ArrowWriter

pub struct ArrowWriter<W> { /* private fields */ }

Encodes RecordBatches into an ORC file. Will encode batch_size rows at a time into a stripe, flushing the stripe to the underlying writer when it’s estimated memory footprint exceeds the configures stripe_byte_size.

Implementations

impl<W: Write> ArrowWriter<W>

pub fn write(&mut self, batch: &RecordBatch) -> Result<()>

Encode the provided batch at batch_size rows at a time, flushing any stripes that exceed the configured stripe size.

pub fn flush_stripe(&mut self) -> Result<()>

Flush any buffered data that hasn’t been written, and write the stripe footer metadata.

pub fn close(self) -> Result<()>

Flush the current stripe if it is still in progress, and write the tail metadata and close the writer.