Skip to main content

Module operators

Module operators 

Source
Expand description

Pipeline operators for declarative event flows

Each operator implements the PipelineOperator trait and processes a FlowContext during pipeline execution. Operators are compiled from YAML PipelineStep configurations.

§Operator types

Synchronous (1:1) — preserve cardinality:

  • resolve — Resolve an entity by ID or by following a link
  • filter — Drop events that don’t match a condition
  • map — Transform the payload via a Tera template
  • deliver — Send to one or more sinks

Stateful (1:N or N:1) — change cardinality:

  • fan_out — Multiply event for each linked entity (see T2.3)
  • batch — Accumulate events and flush on window expiry (see T2.3)
  • deduplicate — Remove duplicates within a window (see T2.3)
  • rate_limit — Throttle via token bucket (see T2.3)

Re-exports§

pub use batch::BatchOp;
pub use deduplicate::DeduplicateOp;
pub use deliver::DeliverOp;
pub use fan_out::FanOutOp;
pub use filter::FilterOp;
pub use map::MapOp;
pub use rate_limit::RateLimitOp;
pub use resolve::ResolveOp;

Modules§

batch
Batch operator — accumulates events by key within a time window
deduplicate
Deduplicate operator — eliminates duplicate events within a sliding window
deliver
Deliver operator — sends the payload to configured sinks
fan_out
Fan-out operator — multiplies events across linked entities
filter
Filter operator — evaluates a boolean condition against the FlowContext
map
Map operator — transforms the payload via Tera templates
rate_limit
Rate limit operator — throttles event throughput via token bucket
resolve
Resolve operator — resolves an entity by ID or by following a link

Enums§

OpResult
Result of executing a pipeline operator

Traits§

PipelineOperator
Trait for pipeline operators