Module datafusion::datasource::listing

source ·
Expand description

A table that uses the ObjectStore listing capability to get the list of files to process.

Structs

  • FileRange
    Only scan a subset of Row Groups from the Parquet file whose data “midpoint” lies within the [start, end) byte offsets. This option can be used to scan non-overlapping sections of a Parquet file in parallel.
  • ListingOptions
    Options for creating a ListingTable
  • ListingTable
    Reads data from one or more files via an ObjectStore. For example, from local files or objects from AWS S3. Implements TableProvider, a DataFusion data source.
  • ListingTableConfig
    Configuration for creating a ListingTable
  • ListingTableUrl
    A parsed URL identifying files for a listing table, see ListingTableUrl::parse for more information on the supported expressions
  • PartitionedFile
    A single file or part of a file that should be read, along with its schema, statistics and partition column values that need to be appended to each row.

Type Definitions