Skip to main content

load_transforms_from_args

Function load_transforms_from_args 

Source
pub fn load_transforms_from_args(
    transforms_config: Option<&Path>,
) -> Result<(Pipeline, ApplyOpts)>
Expand description

Load --transforms-config into a Pipeline + ApplyOpts.

Omit flag vs empty / passthrough file — different buffering cadence:

CLI inputPipelineApplyOpts
Flag omitted (None)Identity (no stage dispatch)ApplyOpts::identity() (batch_size = 1, max_in_flight = 1)
Empty / passthrough-only TOMLIdentity stagesApplyOpts::default() (batch_size = 1000)

Both yield an identity pipeline, but omit uses per-event CDC cadence (batch_size = 1, max_in_flight = 1) while an empty/passthrough config keeps config defaults (batch_size = 1000). That changes buffering cadence even when no transform stages run. There is no separate oneshot write path for identity — omit pins W=1 for CDC cadence only.

Bad TOML or unresolvable worker argv fails fast before sync starts (worker spawn / argv fail-fast is also covered in pipeline config tests).