Struct FilesDestination 

pub struct FilesDestination { /* private fields */ }

Local files destination. Writes part-NNNNN.{extension} files to a directory, or one {dir}.{extension} when single_file. Write is atomic via tmp dir + rename. Written paths land in RunReport.written_objects.

Implementations

impl FilesDestination

pub fn new( path: PathBuf, format: Arc<dyn FormatWrite>, single_file: bool, ) -> Self

Build a destination. No I/O performed.

Trait Implementations

impl Clone for FilesDestination

fn clone(&self) -> FilesDestination

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Destination for FilesDestination

fn write_partitions<'async_trait>( self: Box<Self>, partitions: Vec<BatchStream>, ) -> Pin<Box<dyn Future<Output = Result<RunReport, TransferredError>> + Send + 'async_trait>>

where Self: 'async_trait,

Consume the destination and write the partitions. Single-shot. Schema is taken from the first batch each partition emits.