Struct FileGroup 

pub struct FileGroup { /* private fields */ }

Represents a group of partitioned files that’ll be processed by a single thread. Maintains optional statistics across all files in the group.

Statistics

The group-level FileGroup::file_statistics field contains merged statistics from all files in the group for the full table schema (file columns + partition columns).

Partition column statistics are derived from the individual file partition values:

• min = minimum partition value across all files in the group
• max = maximum partition value across all files in the group
• null_count = 0 (partition values are never null)

This allows query optimizers to prune entire file groups based on partition bounds.

Implementations

impl FileGroup

pub fn new(files: Vec<PartitionedFile>) -> Self

Creates a new FileGroup from a vector of PartitionedFile objects

pub fn len(&self) -> usize

Returns the number of files in this group

pub fn with_statistics(self, statistics: Arc<Statistics>) -> Self

Set the statistics for this group

pub fn files(&self) -> &[PartitionedFile]

Returns a slice of the files in this group

pub fn iter(&self) -> impl Iterator<Item = &PartitionedFile>

pub fn into_inner(self) -> Vec<PartitionedFile>

pub fn is_empty(&self) -> bool

pub fn pop(&mut self) -> Option<PartitionedFile>

Removes the last element from the files vector and returns it, or None if empty

pub fn push(&mut self, partitioned_file: PartitionedFile)

Adds a file to the group

pub fn file_statistics(&self, index: Option<usize>) -> Option<&Statistics>

Get the specific file statistics for the given index If the index is None, return the FileGroup statistics

pub fn statistics_mut(&mut self) -> Option<&mut Statistics>

Get the mutable reference to the statistics for this group

pub fn split_files(self, n: usize) -> Vec<FileGroup>

Partition the list of files into n groups

pub fn group_by_partition_values( self, max_target_partitions: usize, ) -> Vec<FileGroup>

Groups files by their partition values, ensuring all files with same partition values are in the same group.

Note: May return fewer groups than max_target_partitions when the number of unique partition values is less than the target.

Trait Implementations

impl Clone for FileGroup

fn clone(&self) -> FileGroup

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for FileGroup

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for FileGroup

fn default() -> Self

Returns the “default value” for a type.

impl From<Vec<PartitionedFile>> for FileGroup

fn from(files: Vec<PartitionedFile>) -> Self

Converts to this type from the input type.

impl FromIterator<PartitionedFile> for FileGroup

fn from_iter<I: IntoIterator<Item = PartitionedFile>>(iter: I) -> Self

Creates a value from an iterator.

impl Index<usize> for FileGroup

type Output = PartitionedFile

The returned type after indexing.

fn index(&self, index: usize) -> &Self::Output

Performs the indexing (container[index]) operation.

impl IndexMut<usize> for FileGroup

fn index_mut(&mut self, index: usize) -> &mut Self::Output

Performs the mutable indexing (container[index]) operation.