Expand description
Logic for managing groups of PartitionedFiles in DataFusion
Structs§
- File
Group - Represents a group of partitioned files that’ll be processed by a single thread. Maintains optional statistics across all files in the group.
- File
Group Partitioner - Repartition input files into
target_partitionspartitions, if total file size exceedrepartition_file_min_size