Module datafusion::datasource::listing
source · Expand description
A table that uses the ObjectStore
listing capability
to get the list of files to process.
Structs
- Only scan a subset of Row Groups from the Parquet file whose data “midpoint” lies within the [start, end) byte offsets. This option can be used to scan non-overlapping sections of a Parquet file in parallel.
- Options for creating a
ListingTable
- Reads data from one or more files via an
ObjectStore
. For example, from local files or objects from AWS S3. ImplementsTableProvider
, a DataFusion data source. - Configuration for creating a
ListingTable
- A parsed URL identifying files for a listing table, see
ListingTableUrl::parse
for more information on the supported expressions - A single file or part of a file that should be read, along with its schema, statistics and partition column values that need to be appended to each row.
Type Definitions
- Stream of files get listed from object store