pub fn compute_all_files_statistics(
file_groups: Vec<FileGroup>,
table_schema: SchemaRef,
collect_stats: bool,
inexact_stats: bool,
) -> Result<(Vec<FileGroup>, Statistics)>
Expand description
Computes statistics for all files across multiple file groups.
This function:
- Computes statistics for each individual file group
- Summary statistics across all file groups
- Optionally marks statistics as inexact
§Parameters
file_groups
- Vector of file groups to processtable_schema
- Schema of the tablecollect_stats
- Whether to collect statisticsinexact_stats
- Whether to mark the resulting statistics as inexact
§Returns
A tuple containing:
- The processed file groups with their individual statistics attached
- The summary statistics across all file groups, aka all files summary statistics