Struct IncrementalAnalysisRunner 

pub struct IncrementalAnalysisRunner { /* private fields */ }

Orchestrates incremental analysis across partitions.

The runner maintains a collection of analyzers and manages their state across data partitions, enabling efficient incremental computation.

Implementations

impl IncrementalAnalysisRunner

pub fn new(state_store: Box<dyn StateStore>) -> Self

Creates a new incremental analysis runner

pub fn with_config( state_store: Box<dyn StateStore>, config: IncrementalConfig, ) -> Self

Creates a new incremental analysis runner with custom config

pub fn add_analyzer<A>(self, analyzer: A) -> Self

where A: Analyzer + 'static, A::State: Serialize + for<'de> Deserialize<'de>, A::Metric: Into<MetricValue>,

Adds an analyzer to the runner

pub async fn analyze_partition( &self, ctx: &SessionContext, partition: &str, ) -> AnalyzerResult<AnalyzerContext>

Analyzes a single partition, computing and storing its state

Arguments

• ctx - DataFusion context with registered data
• partition - Partition identifier

Returns

Analysis context with computed metrics

pub async fn analyze_incremental( &self, ctx: &SessionContext, partition: &str, ) -> AnalyzerResult<AnalyzerContext>

Analyzes new data and merges with existing partition state

This method loads the existing state for a partition, computes new state from the provided data, merges them, and saves the updated state.

Arguments

• ctx - DataFusion context with new data
• partition - Partition identifier

pub async fn analyze_partitions( &self, partitions: &[String], ) -> AnalyzerResult<AnalyzerContext>

Computes metrics over a range of partitions by merging their states.

Arguments

• partitions - List of partition identifiers to analyze

Returns

The merged analysis context with aggregate metrics

pub fn analyzer_count(&self) -> usize

Returns the number of analyzers configured

pub async fn list_partitions(&self) -> AnalyzerResult<Vec<String>>

Lists all stored partitions

pub async fn delete_partition(&self, partition: &str) -> AnalyzerResult<()>

Deletes a partition’s stored state