Module datafusion::datasource::file_format

Module containing helper methods for the various file formats See write.rs for write related helper methods

Modules

• arrow
  ArrowFormat: Apache Arrow FileFormat abstractions
• avro
  AvroFormat Apache Avro FileFormat abstractions
• csv
  CsvFormat, Comma Separated Value (CSV) FileFormat abstractions
• file_compression_type
  File Compression type abstraction
• json
  JsonFormat: Line delimited JSON FileFormat abstractions
• options
  User facing options for the file formats readers
• parquet
  ParquetFormat: Parquet FileFormat abstractions
• write
  Module containing helper methods/traits related to enabling write support for the various file formats

Constants

• DEFAULT_SCHEMA_INFER_MAX_RECORD
  Default max records to scan to infer the schema

Traits

• FileFormat
  This trait abstracts all the file format specific implementations from the TableProvider. This helps code re-utilization across providers that support the same file formats.