Struct PipelineSpec 

pub struct PipelineSpec {

    pub source: Option<ConnectorSpec>,
    pub sink: Option<ConnectorSpec>,
    pub sources: HashMap<String, ConnectorSpec>,
    pub sinks: HashMap<String, ConnectorSpec>,
    pub transforms: Vec<TransformSpec>,
    pub state: Option<StateStoreSpec>,
    pub dlq: Option<DlqSpec>,
    pub quality: Option<QualitySpec>,
    pub contract: Option<ContractSpec>,
    pub masking: Option<MaskingSpec>,
    pub schema: Option<SchemaDriftSpec>,
    pub nodes: HashMap<String, NodeSpec>,
    pub edges: Vec<EdgeSpec>,
}

The base pipeline definition. Each matrix row is resolved against the template catalogs below; the singular source / sink fields are the legacy way to declare a single template (internally named default).

Fields

source: Option<ConnectorSpec>

Legacy singular source — registers as a template named default. Defining both source and sources.default is an error at expand time.

sink: Option<ConnectorSpec>

Legacy singular sink — registers as a template named default.

sources: HashMap<String, ConnectorSpec>

Named source templates. A matrix row picks one via source.ref: NAME.

sinks: HashMap<String, ConnectorSpec>

Named sink templates. A matrix row picks one via sink.ref: NAME.

transforms: Vec<TransformSpec>

state: Option<StateStoreSpec>

dlq: Option<DlqSpec>

quality: Option<QualitySpec>

Available on crate feature quality only.

Data-quality checks (pipeline-level; no matrix-row override in v1).

contract: Option<ContractSpec>

Available on crate feature contract only.

Data contract (pipeline-level; no matrix-row override in v1): a versioned output schema/constraint promise enforced per page after transforms and quality checks (#204). See faucet schema contract.

masking: Option<MaskingSpec>

Available on crate feature masking only.

PII detection + column-level masking policy (pipeline-level; no matrix-row override in v1): classify sensitive fields (by name pattern, value detector, or explicit list) and redact/hash/tokenize/partial-mask them per page — before every sink write, the DLQ, and lineage sampling (#206). Rules can be scoped per destination sink via applies_to. See faucet schema masking and faucet masking.

schema: Option<SchemaDriftSpec>

Schema-drift handling policy (pipeline-level; no matrix-row override in v1).

nodes: HashMap<String, NodeSpec>

Topology-mode nodes (issue #71): an explicit graph of typed nodes (source / transform / tee / merge / join / sink) keyed by node id. When non-empty this pipeline runs in topology mode and the top-level matrix: block must be empty (they are mutually exclusive).

edges: Vec<EdgeSpec>

Topology-mode edges connecting nodes (issue #71). Each edge names a producer (from) and consumer (to); a join’s incoming edges also carry an as: label matching the join’s build/probe edge names.

Trait Implementations

impl Clone for PipelineSpec

fn clone(&self) -> PipelineSpec

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PipelineSpec

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for PipelineSpec

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl JsonSchema for PipelineSpec

fn schema_name() -> Cow<'static, str>

The name of the generated JSON Schema.

fn schema_id() -> Cow<'static, str>

Returns a string that uniquely identifies the schema produced by this type.

fn json_schema(generator: &mut SchemaGenerator) -> Schema

Generates a JSON Schema for this type.

fn inline_schema() -> bool

Whether JSON Schemas generated for this type should be included directly in parent schemas, rather than being re-used where possible using the $ref keyword.

impl Serialize for PipelineSpec

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.