Module file_groups

Logic for managing groups of PartitionedFiles in DataFusion

Structs

FileGroup

Represents a group of partitioned files that’ll be processed by a single thread. Maintains optional statistics across all files in the group.

FileGroupPartitioner

Repartition input files into target_partitions partitions, if total file size exceed repartition_file_min_size