Enum BatchCheck 

pub enum BatchCheck {
    RowCount {
        min: Option<usize>,
        max: Option<usize>,
        on_failure: OnFailure,
    },
    NullRate {
        field: String,
        max: f64,
        on_failure: OnFailure,
    },
    Unique {
        fields: Vec<String>,
        on_failure: OnFailure,
    },
    DistinctCount {
        field: String,
        min: Option<usize>,
        max: Option<usize>,
        on_failure: OnFailure,
    },
}

Available on crate feature quality only.

A per-batch check, evaluated per page over the survivors of the per-record pass.

Scope is one page, not the whole run — with a source batch_size of 1000, row_count sees 1000 rows at a time. Set the source’s batch_size: 0 to evaluate these over the entire result set instead.

The aggregate checks (row_count / null_rate / distinct_count) cannot blame an individual row, so they accept only OnFailure::Abort or OnFailure::QuarantineBatch; unique is row-attributable and so accepts quarantine or abort. Either way the wrong choice is rejected at config load.

Variants

RowCount

Survivor count is within [min, max] (at least one bound required).

Fields

min: Option<usize>

Inclusive minimum surviving rows in the page. Omit for no lower bound.

max: Option<usize>

Inclusive maximum surviving rows in the page. Omit for no upper bound. At least one of min/max is required, and min <= max, both enforced at config load.

on_failure: OnFailure

What a failure does: abort, or quarantine_batch (every survivor in the page goes to the DLQ and nothing is written).

NullRate

Null-or-missing rate of field across survivors is <= max.

Fields

field: String

Path to the measured field. A missing field counts the same as an explicit null.

max: f64

Maximum allowed null-or-missing proportion, in [0.0, 1.0]. Out-of-range values are rejected at compile time.

on_failure: OnFailure

What a failure does: abort, or quarantine_batch (every survivor in the page goes to the DLQ and nothing is written).

Unique

The composite fields tuple is unique across survivors.

Fields

fields: Vec<String>

Paths forming the uniqueness key, in order. One path for a simple key, several for a composite one. Must be non-empty. A missing field is a distinct key value from an explicit null.

on_failure: OnFailure

What a failure does. This check names the offending rows, so quarantine sends the duplicate occurrences to the DLQ (the first occurrence of each key is kept); abort fails the run.

DistinctCount

Distinct values of field across survivors is within [min, max].

Fields

field: String

Path to the counted field. A missing field counts as its own distinct value, separate from an explicit null.

min: Option<usize>

Inclusive minimum number of distinct values. Omit for no lower bound.

max: Option<usize>

Inclusive maximum number of distinct values. Omit for no upper bound. At least one of min/max is required, and min <= max, both enforced at config load.

on_failure: OnFailure

What a failure does: abort, or quarantine_batch (every survivor in the page goes to the DLQ and nothing is written).

Trait Implementations

impl Clone for BatchCheck

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for BatchCheck

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for BatchCheck

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl JsonSchema for BatchCheck

fn schema_name() -> Cow<'static, str>

The name of the generated JSON Schema.

fn schema_id() -> Cow<'static, str>

Returns a string that uniquely identifies the schema produced by this type.

fn json_schema(generator: &mut SchemaGenerator) -> Schema

Generates a JSON Schema for this type.

fn inline_schema() -> bool

Whether JSON Schemas generated for this type should be included directly in parent schemas, rather than being re-used where possible using the $ref keyword.

impl Serialize for BatchCheck

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.