Struct TextColumnStats 

pub struct TextColumnStats {
    pub min_len: usize,
    pub max_len: usize,
    pub mean_len: f64,
    pub p50_len: usize,
    pub p95_len: usize,
    pub p99_len: usize,
    pub empty_count: usize,
    pub preamble_count: usize,
    pub total: usize,
}

Statistics for a text (string) column — useful for ML classification audits.

Fields

min_len: usize

Minimum character length

max_len: usize

Maximum character length

mean_len: f64

Mean character length

p50_len: usize

Median character length (P50)

p95_len: usize

95th percentile character length

p99_len: usize

99th percentile character length

empty_count: usize

Number of empty or whitespace-only strings

preamble_count: usize

Number of strings matching a preamble pattern (e.g., “#!/”)

total: usize

Total valid (non-null) strings

Implementations

impl TextColumnStats

pub fn from_dataset( dataset: &ArrowDataset, column: &str, preamble_prefix: Option<&str>, ) -> Result<Self>

Compute text column statistics from an ArrowDataset.

Arguments

• dataset - Source dataset
• column - Name of the string column
• preamble_prefix - Optional prefix to count as “preamble” (e.g., “#!/”)

Errors

Returns error if column not found or not a string type.

Trait Implementations

impl Clone for TextColumnStats

fn clone(&self) -> TextColumnStats

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TextColumnStats

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.