Struct MultiSource 

pub struct MultiSource { /* private fields */ }

An ordered set of parquet partitions (local files and/or remote objects) with footers loaded and validated up front (see the module docs for the compatibility rules).

Implementations

impl MultiSource

pub fn from_sources( root: String, parts: Vec<InputSource>, ) -> Result<Self, InputError>

Build a multi source over already-constructed parts: load every part’s footer and validate compatibility against part 0 (see the module docs). parts must be non-empty and already ordered. Footer loads run with bounded concurrency ([FOOTER_LOAD_CONCURRENCY]): a remote footer is two range requests, so hundreds of parts would otherwise serialize hundreds of round-trips — but must not open hundreds of connections at once either.

Trait Implementations

impl Debug for MultiSource

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.