Module file_scan_config 

FileScanConfig to configure scanning of possibly partitioned file sources.

Structs

FileScanConfig

FileScanConfig represents scanning data from a group of files

FileScanConfigBuilder

A builder for FileScanConfig’s.

Functions

output_partitioning_from_partition_fields

Builds output partitioning over partition_cols (resolved to their indices in schema) with partition_count partitions. Returns None when there are no partition columns. Callers use this to declare the output partitioning of a scan whose file groups are organized by partition column values.

wrap_partition_type_in_dict

Convert type to a type suitable for use as a ListingTable partition column. Returns Dictionary(UInt16, val_type), which is a reasonable trade off between a reasonable number of partition values and space efficiency.

wrap_partition_value_in_dict

Convert a ScalarValue of partition columns to a type, as described in the documentation of wrap_partition_type_in_dict, which can wrap the types.