pub struct ParquetFileReader {
pub file_metrics: ParquetFileMetrics,
pub inner: ParquetObjectReader,
pub partitioned_file: PartitionedFile,
}Expand description
Implements AsyncFileReader for a parquet file in object storage.
This implementation uses the ParquetObjectReader to read data from the
object store on demand, as required, tracking the number of bytes read.
This implementation does not coalesce I/O operations or cache bytes. Such
optimizations can be done either at the object store level or by providing a
custom implementation of ParquetFileReaderFactory.
Fields§
§file_metrics: ParquetFileMetrics§inner: ParquetObjectReader§partitioned_file: PartitionedFileTrait Implementations§
Source§impl AsyncFileReader for ParquetFileReader
impl AsyncFileReader for ParquetFileReader
Source§fn get_bytes(&mut self, range: Range<u64>) -> BoxFuture<'_, Result<Bytes>>
fn get_bytes(&mut self, range: Range<u64>) -> BoxFuture<'_, Result<Bytes>>
Retrieve the bytes in
rangeSource§fn get_byte_ranges(
&mut self,
ranges: Vec<Range<u64>>,
) -> BoxFuture<'_, Result<Vec<Bytes>>>where
Self: Send,
fn get_byte_ranges(
&mut self,
ranges: Vec<Range<u64>>,
) -> BoxFuture<'_, Result<Vec<Bytes>>>where
Self: Send,
Retrieve multiple byte ranges. The default implementation will call
get_bytes sequentiallySource§fn get_metadata<'a>(
&'a mut self,
options: Option<&'a ArrowReaderOptions>,
) -> BoxFuture<'a, Result<Arc<ParquetMetaData>>>
fn get_metadata<'a>( &'a mut self, options: Option<&'a ArrowReaderOptions>, ) -> BoxFuture<'a, Result<Arc<ParquetMetaData>>>
Return a future which results in the
ParquetMetaData for this Parquet file. Read moreAuto Trait Implementations§
impl Freeze for ParquetFileReader
impl !RefUnwindSafe for ParquetFileReader
impl Send for ParquetFileReader
impl Sync for ParquetFileReader
impl Unpin for ParquetFileReader
impl !UnwindSafe for ParquetFileReader
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more