Modules
Structs
A FallibleStreamingIterator
that decompresses CompressedDataPage
into DataPage
.
A MutStreamingIterator
that reads column chunks one by one,
returning a PageIterator
per column.
Decompressor that allows re-using the page buffer of PageIterator
.
A page iterator iterates over row group’s pages. In parquet, pages are guaranteed to be contiguously arranged in memory and therefore must be read in sequence.
A MutStreamingIterator
of pre-read column chunks
Enums
State of MutStreamingIterator
.
Traits
Trait describing a MutStreamingIterator
of column chunks.
Functions
Decompresses the page, using buffer
for decompression.
If page.buffer.len() == 0
, there was no decompression and the buffer was moved.
Else, decompression took place.
Filters row group metadata to only those row groups, for which the predicate function returns true
Returns a ColumnIterator
of column chunks corresponding to field
.
Contrarily to get_page_iterator
that returns a single iterator of pages, this iterator
returns multiple iterators, one per physical column of the field
.
For primitive fields (e.g. i64
), ColumnIterator
yields exactly one column.
For complex fields, it yields multiple columns.
Returns an Iterator
of ColumnChunkMetaData
corresponding to the columns
from field
at row_group
.
For primitive fields (e.g. i64
), the iterator has exactly one item.
Returns a new PageIterator
by seeking reader
to the begining of column_chunk
.
Returns a stream of compressed data pages
Reads a file’s metadata.
Type Definitions
Type declaration for a page filter