Skip to main content

Module stream_loader

Module stream_loader 

Source

Structs§

CsvReadOptions
Options controlling how a CSV stream is parsed.
StreamCsvLoader
Advanced stream-based CSV loader with string interning

Functions§

collect_column_names
Compute the ordered union of object keys across the first sample_size records. Order of first occurrence is preserved so the column layout is stable. Non-object records are skipped.
detect_delimiter_from_path
Pick a default delimiter from a path’s extension.
load_csv_from_reader
Simple wrapper for loading CSV without advanced features. Defaults to comma delimiter; for other delimiters use load_csv_from_reader_with_opts.
load_csv_from_reader_with_opts
As load_csv_from_reader, but honouring caller-supplied CsvReadOptions (delimiter, headers).
load_json_from_reader
Load JSON data from any Read source into a DataTable.
parse_delimiter_arg
Parse a user-supplied delimiter string into a single byte.
parse_json_records
Parse JSON content as either a JSON array of objects or JSONL (newline-delimited JSON, one object per line). The format is detected by peeking at the first non-whitespace byte: [ starts an array, anything else is parsed line-by-line.
resolve_delimiter
Resolve which delimiter to use for a given path.