Skip to main content

Crate csv_ingest

Crate csv_ingest 

Source
Expand description

Streaming CSV ingestion with optional fast local path.

  • Streaming path: works with local files and gzip/zstd.
  • Fast local path: feature fast_local, uncompressed local UTF-8 only.

Data shape:

  • CsvIngestSummary { row_count, headers }
  • Streaming rows: ByteRecord (access with get(idx) -> Option<&[u8]>)

Structs§

ByteRecord
A single CSV record stored as raw bytes.
CsvIngestSummary
A count-and-header summary of a parsed CSV stream.
CsvMeta
CsvOptions
CSV dialect options shared by streaming and fast-local parsing.
CsvParser
A streaming, byte-oriented CSV parser.
TranscodingError
A malformed byte sequence encountered while strictly transcoding to UTF-8.

Enums§

CsvHeaderMode
How the first CSV record is interpreted.
CsvIngestError
Error returned by every public parsing path in this crate.
CsvTerminator
How CSV records are terminated.
CsvTrim
ASCII whitespace trimming applied while parsing byte records.
DecodePolicy
Controls how malformed byte sequences are handled while transcoding to UTF-8.

Functions§

build_csv_reader
Wrap an AsyncRead with optional decompression and UTF-8 transcoding.
fast_local_processfast_local
Fast local parser for uncompressed UTF-8 CSV files using mmap and parallel chunking.
reader_from_path
Build a reader from a local file path (lightweight meta from extension).
summarize_csv_path
Summarize a local CSV path and return the transport metadata used.
summarize_csv_stream
Summarize a CSV stream using the record-oriented parser contract.

Type Aliases§

BoxedCsvReader
Type-erased asynchronous reader returned by the transport helpers.
CsvResult