Struct RecordBatchValidator 

pub struct RecordBatchValidator;

Streaming data validator for Apache Arrow record batches.

Implementations

impl RecordBatchValidator

pub fn assert_not_null(batch: &RecordBatch, column: &str) -> Result<()>

Validates that a specified column contains no NULL entries in the batch.

pub fn assert_unique(batch: &RecordBatch, column: &str) -> Result<()>

Validates that a string/Utf8 column contains strictly unique entries in the batch.

pub fn assert_unique_key( batches: &[RecordBatch], columns: &[String], ) -> Result<()>

Global composite uniqueness across all batches (stringified cell values).

pub fn assert_accepted_values( batch: &RecordBatch, column: &str, accepted_values: &[&str], ) -> Result<()>

Validates that all non-null values in a Utf8 column belong to the accepted_values set.

pub fn validate_batches( batches: &[RecordBatch], assertions: &[Assertion], ) -> ValidationResult

Runs a suite of assertions over an incoming array of RecordBatches.

Unique / per-batch not_null still walk batches; UniqueKey is global.