Struct ArrowTableWriter 

pub struct ArrowTableWriter<Builder: Default + StructArrayBuilder> {
    pub flush_threshold: usize,
    /* private fields */
}

Writer to a .arrow file, usable with ParallelDatasetWriter

Builder should follow the pattern documented by arrow::builder

Fields

flush_threshold: usize

Implementations

impl<Builder: Default + StructArrayBuilder> ArrowTableWriter<Builder>

pub fn builder(&mut self) -> Result<&mut Builder>

Flushes the internal buffer is too large, then returns the array builder.

Trait Implementations

impl<Builder: Default + StructArrayBuilder> Drop for ArrowTableWriter<Builder>

fn drop(&mut self)

Executes the destructor for this type.

fn pin_drop(self: Pin<&mut Self>)

🔬This is a nightly-only experimental API. (pin_ergonomics)

Execute the destructor for this type, but different to Drop::drop, it requires self to be pinned.

impl<Builder: Default + StructArrayBuilder> TableWriter for ArrowTableWriter<Builder>

type Schema = Schema

type CloseResult = ()

type Config = Option<usize>

fn new( path: PathBuf, schema: Self::Schema, config: Option<usize>, ) -> Result<Self>

fn flush(&mut self) -> Result<()>

Calls .into() on the internal builder, and writes its result to disk.

fn close(self) -> Result<()>