Struct BloomFilterStatistics 

pub struct BloomFilterStatistics { /* private fields */ }

In memory Parquet Split Block Bloom Filters (SBBF).

This structure implements PruningStatistics and is used to prune Parquet row groups and data pages based on the query predicate.

Implementations

impl BloomFilterStatistics

pub fn new() -> Self

Create an empty BloomFilterStatistics

pub fn with_capacity(capacity: usize) -> Self

Create an empty BloomFilterStatistics with the specified capacity

pub fn insert( &mut self, column: impl Into<String>, sbbf: Sbbf, ty: Type, type_length: i32, )

Add a Bloom filter for the specified column, along with the column’s Parquet physical Type and type length from the column descriptor.

Trait Implementations

impl Clone for BloomFilterStatistics

fn clone(&self) -> BloomFilterStatistics

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for BloomFilterStatistics

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for BloomFilterStatistics

fn default() -> BloomFilterStatistics

Returns the “default value” for a type.

impl PruningStatistics for BloomFilterStatistics

fn contained( &self, column: &Column, values: &HashSet<ScalarValue>, ) -> Option<BooleanArray>

Use bloom filters to determine if we are sure this column can not possibly contain values

The contained API returns false if the bloom filters knows that ALL of the values in a column are not present.

fn min_values(&self, _column: &Column) -> Option<ArrayRef>

Return the minimum values for the named column, if known.

fn max_values(&self, _column: &Column) -> Option<ArrayRef>

Return the maximum values for the named column, if known.

fn num_containers(&self) -> usize

Return the number of containers (e.g. Row Groups) being pruned with these statistics.

fn null_counts(&self, _column: &Column) -> Option<ArrayRef>

Return the number of null values for the named column as an UInt64Array

fn row_counts(&self) -> Option<ArrayRef>

Return the number of rows in each container as an UInt64Array.