compute_all_files_statistics

Function compute_all_files_statistics 

Source
pub fn compute_all_files_statistics(
    file_groups: Vec<FileGroup>,
    table_schema: SchemaRef,
    collect_stats: bool,
    inexact_stats: bool,
) -> Result<(Vec<FileGroup>, Statistics)>
Expand description

Computes statistics for all files across multiple file groups.

This function:

  1. Computes statistics for each individual file group
  2. Summary statistics across all file groups
  3. Optionally marks statistics as inexact

§Parameters

  • file_groups - Vector of file groups to process
  • table_schema - Schema of the table
  • collect_stats - Whether to collect statistics
  • inexact_stats - Whether to mark the resulting statistics as inexact

§Returns

A tuple containing:

  • The processed file groups with their individual statistics attached
  • The summary statistics across all file groups, aka all files summary statistics