Struct MultiSourceValidator 

pub struct MultiSourceValidator { /* private fields */ }

Multi-source validation engine for cross-table data validation.

This engine manages multiple data sources and provides efficient validation across heterogeneous datasets with optimized query execution and caching.

Implementations

impl MultiSourceValidator

pub fn new() -> Self

Create a new multi-source validator.

pub fn with_context(ctx: SessionContext) -> Self

Create a new multi-source validator with a custom session context.

pub fn with_telemetry(self, telemetry: Arc<TermTelemetry>) -> Self

Set telemetry for observability.

pub fn with_caching(self, enable: bool) -> Self

Enable or disable query result caching.

pub fn with_max_cache_size(self, size_bytes: usize) -> Self

Set maximum cache size in bytes.

pub async fn add_source<S: DataSource + 'static>( &mut self, name: impl Into<String>, source: S, ) -> Result<()>

Add a data source to the validator.

Arguments

• name - The name to register the source as
• source - The data source to register

Examples

let mut validator = MultiSourceValidator::new();
validator.add_source("orders", CsvSource::new("orders.csv")?).await?;

pub fn context(&self) -> &SessionContext

Get the DataFusion session context.

This provides direct access to the underlying context for advanced use cases.

pub fn get_source(&self, name: &str) -> Option<&Arc<dyn DataSource>>

Get a registered data source by name.

pub fn list_sources(&self) -> Vec<String>

List all registered data sources.

pub async fn run_suite( &self, suite: &ValidationSuite, ) -> Result<ValidationResult>

Run a validation suite across registered data sources.

Arguments

• suite - The validation suite to run

Returns

The validation results from running the suite

pub async fn execute_query(&mut self, sql: &str) -> Result<Vec<RecordBatch>>

Execute a SQL query with optional caching.

This method is used internally by constraints for performance optimization.

pub fn cache_stats(&self) -> CacheStats

Get cache statistics.

Trait Implementations

impl Default for MultiSourceValidator

fn default() -> Self

Returns the “default value” for a type.