Skip to main content

Module format

Module format 

Source
Expand description

On-the-wire format detection for data files. Objects can be stored as gzip CSV (.csv.gz, the default write format), plain CSV (.csv), or Apache Parquet (.parquet, requires the parquet feature). Detection is by content magic bytes, not the object key, so a file parses correctly regardless of its extension and existing gzip CSV data keeps working unchanged.

Enumsยง

Format
The storage encoding of a data object, inferred from its leading bytes.