Struct CachedParquetFileReader 

pub struct CachedParquetFileReader {
    pub file_metrics: ParquetFileMetrics,
    pub inner: ParquetObjectReader,
    /* private fields */
}

Implements AsyncFileReader for a Parquet file in object storage. Reads the file metadata from the FileMetadataCache, if available, otherwise reads it directly from the file and then updates the cache.

Fields

file_metrics: ParquetFileMetrics

inner: ParquetObjectReader

Implementations

impl CachedParquetFileReader

pub fn new( file_metrics: ParquetFileMetrics, store: Arc<dyn ObjectStore>, inner: ParquetObjectReader, partitioned_file: PartitionedFile, metadata_cache: Arc<dyn FileMetadataCache>, metadata_size_hint: Option<usize>, ) -> Self

Trait Implementations

impl AsyncFileReader for CachedParquetFileReader

fn get_bytes(&mut self, range: Range<u64>) -> BoxFuture<'_, Result<Bytes>>

Retrieve the bytes in range

fn get_byte_ranges( &mut self, ranges: Vec<Range<u64>>, ) -> BoxFuture<'_, Result<Vec<Bytes>>>

where Self: Send,

Retrieve multiple byte ranges. The default implementation will call get_bytes sequentially

fn get_metadata<'a>( &'a mut self, options: Option<&'a ArrowReaderOptions>, ) -> BoxFuture<'a, Result<Arc<ParquetMetaData>>>

Return a future which results in the ParquetMetaData for this Parquet file.

impl Drop for CachedParquetFileReader

fn drop(&mut self)

Executes the destructor for this type.