Enum Format 

pub enum Format {
    Csv,
    Tsv,
    Ndjson,
    Json,
    Parquet,
    Arrow,
}

The input formats the text normalizer understands.

Variants

Csv

Tsv

Ndjson

Newline-delimited JSON (one JSON value per line).

Json

A single JSON document (array of objects, object, or array of scalars).

Parquet

Apache Parquet (binary columnar). Requires the polars feature to read.

Arrow

Apache Arrow IPC / Feather file (binary columnar). Requires polars.

Implementations

impl Format

pub fn token(self) -> &'static str

Stable token recorded in the envelope’s format field.

pub fn is_binary(self) -> bool

Whether this format is binary columnar (read via the Polars backbone).

pub fn from_extension(path: &str) -> Option<Format>

Picks a format from a file extension, if recognized.

pub fn sniff(bytes: &[u8]) -> Option<Format>

Sniffs a format from leading content. Binary magic numbers are checked first (they are not valid UTF-8); then textual sniffing. None if nothing matches.

pub fn resolve(source: &str, bytes: &[u8]) -> Result<Format, AxError>

Resolves the format for source/bytes: extension first, then sniff.

Trait Implementations

impl Clone for Format

fn clone(&self) -> Format

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Format

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Format

fn eq(&self, other: &Format) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for Format

impl Eq for Format

impl StructuralPartialEq for Format