Module datafusion::datasource::file_format

Module containing helper methods for the various file formats

Modules

• arrow
  Apache Arrow format abstractions
• avro
  Apache Avro format abstractions
• csv
  CSV format abstractions
• file_type
  File type abstraction
• json
  Line delimited JSON format abstractions
• options
  User facing options for the file formats readers
• parquet
  Parquet format abstractions

Structs

• AsyncPutWriter
  AsyncPutWriter is an object that facilitates asynchronous writing to object stores. It is specifically designed for the object_store crate’s put method and sends whole bytes at once when the buffer is flushed.

Enums

• FileWriterMode
  An enum that defines different file writer modes.

Constants

• DEFAULT_SCHEMA_INFER_MAX_RECORD
  Default max records to scan to infer the schema

Traits

• BatchSerializer
  A trait that defines the methods required for a RecordBatch serializer.
• FileFormat
  This trait abstracts all the file format specific implementations from the TableProvider. This helps code re-utilization across providers that support the the same file formats.