Struct parquet::format::ColumnMetaData
source · pub struct ColumnMetaData {Show 15 fields
pub type_: Type,
pub encodings: Vec<Encoding>,
pub path_in_schema: Vec<String>,
pub codec: CompressionCodec,
pub num_values: i64,
pub total_uncompressed_size: i64,
pub total_compressed_size: i64,
pub key_value_metadata: Option<Vec<KeyValue>>,
pub data_page_offset: i64,
pub index_page_offset: Option<i64>,
pub dictionary_page_offset: Option<i64>,
pub statistics: Option<Statistics>,
pub encoding_stats: Option<Vec<PageEncodingStats>>,
pub bloom_filter_offset: Option<i64>,
pub bloom_filter_length: Option<i32>,
}
Expand description
Description for column metadata
Fields§
§type_: Type
Type of this column *
encodings: Vec<Encoding>
Set of all encodings used for this column. The purpose is to validate whether we can decode those pages. *
path_in_schema: Vec<String>
Path in schema *
codec: CompressionCodec
Compression codec *
num_values: i64
Number of values in this column *
total_uncompressed_size: i64
total byte size of all uncompressed pages in this column chunk (including the headers) *
total_compressed_size: i64
total byte size of all compressed, and potentially encrypted, pages in this column chunk (including the headers) *
key_value_metadata: Option<Vec<KeyValue>>
Optional key/value metadata *
data_page_offset: i64
Byte offset from beginning of file to first data page *
index_page_offset: Option<i64>
Byte offset from beginning of file to root index page *
dictionary_page_offset: Option<i64>
Byte offset from the beginning of file to first (only) dictionary page *
statistics: Option<Statistics>
optional statistics for this column chunk
encoding_stats: Option<Vec<PageEncodingStats>>
Set of all encodings used for pages in this column chunk. This information can be used to determine if all data pages are dictionary encoded for example *
bloom_filter_offset: Option<i64>
Byte offset from beginning of file to Bloom filter data. *
bloom_filter_length: Option<i32>
Size of Bloom filter data including the serialized header, in bytes. Added in 2.10 so readers may not read this field from old files and it can be obtained after the BloomFilterHeader has been deserialized. Writers should write this field so readers can read the bloom filter in a single I/O.
Implementations§
source§impl ColumnMetaData
impl ColumnMetaData
pub fn new<F8, F10, F11, F12, F13, F14, F15>( type_: Type, encodings: Vec<Encoding>, path_in_schema: Vec<String>, codec: CompressionCodec, num_values: i64, total_uncompressed_size: i64, total_compressed_size: i64, key_value_metadata: F8, data_page_offset: i64, index_page_offset: F10, dictionary_page_offset: F11, statistics: F12, encoding_stats: F13, bloom_filter_offset: F14, bloom_filter_length: F15 ) -> ColumnMetaData
Trait Implementations§
source§impl Clone for ColumnMetaData
impl Clone for ColumnMetaData
source§fn clone(&self) -> ColumnMetaData
fn clone(&self) -> ColumnMetaData
1.0.0 · source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source
. Read moresource§impl Debug for ColumnMetaData
impl Debug for ColumnMetaData
source§impl Hash for ColumnMetaData
impl Hash for ColumnMetaData
source§impl Ord for ColumnMetaData
impl Ord for ColumnMetaData
source§fn cmp(&self, other: &ColumnMetaData) -> Ordering
fn cmp(&self, other: &ColumnMetaData) -> Ordering
1.21.0 · source§fn max(self, other: Self) -> Selfwhere
Self: Sized,
fn max(self, other: Self) -> Selfwhere
Self: Sized,
source§impl PartialEq for ColumnMetaData
impl PartialEq for ColumnMetaData
source§fn eq(&self, other: &ColumnMetaData) -> bool
fn eq(&self, other: &ColumnMetaData) -> bool
self
and other
values to be equal, and is used
by ==
.source§impl PartialOrd for ColumnMetaData
impl PartialOrd for ColumnMetaData
source§fn partial_cmp(&self, other: &ColumnMetaData) -> Option<Ordering>
fn partial_cmp(&self, other: &ColumnMetaData) -> Option<Ordering>
1.0.0 · source§fn le(&self, other: &Rhs) -> bool
fn le(&self, other: &Rhs) -> bool
self
and other
) and is used by the <=
operator. Read more