Module operators

Extension traits for Stream implementing various operators.

A collection of functions taking typed Stream objects as input and producing new Stream objects as output. Many of the operators provide simple, composable functionality. Some of the operators are more complicated, for use with advanced timely dataflow features.

The Operator trait provides general operators whose behavior can be supplied using closures accepting input and output handles. Most of the operators in this module are defined using these two general operators.

Re-exports

pub use self::enterleave::Enter;

pub use self::enterleave::EnterAt;

pub use self::enterleave::Leave;

pub use self::input::Input;

pub use self::unordered_input::UnorderedInput;

pub use self::unordered_input::UnorderedInputCore;

pub use self::feedback::Feedback;

pub use self::feedback::LoopVariable;

pub use self::feedback::ConnectLoop;

pub use self::concat::Concat;

pub use self::concat::Concatenate;

pub use self::partition::Partition;

pub use self::map::Map;

pub use self::inspect::Inspect;

pub use self::inspect::InspectCore;

pub use self::filter::Filter;

pub use self::delay::Delay;

pub use self::exchange::Exchange;

pub use self::broadcast::Broadcast;

pub use self::probe::Probe;

pub use self::to_stream::ToStream;

pub use self::to_stream::ToStreamCore;

pub use self::to_stream::ToStreamAsync;

pub use self::to_stream::Event;

pub use self::capture::Capture;

pub use self::branch::Branch;

pub use self::branch::BranchWhen;

pub use self::ok_err::OkErr;

pub use self::result::ResultStream;

pub use self::generic::Operator;

pub use self::generic::Notificator;

pub use self::generic::FrontierNotificator;

pub use self::reclock::Reclock;

pub use self::count::Accumulate;

Modules

aggregation

Aggregation operators of various flavors

branch

Operators that separate one stream into two streams based on some condition

broadcast

Broadcast records to all workers.

capture

Operators to capture and replay timely dataflow streams.

concat

Merges the contents of multiple streams.

count

Counts the number of records at each time.

delay

Operators acting on timestamps to logically delay records

enterleave

Extension traits to move a Stream between an outer Scope and inner Scope.

exchange

Exchange records between workers.

feedback

Create cycles in a timely dataflow graph.

filter

Filters a stream by a predicate.

flow_controlled

Methods to construct flow-controlled sources.

generic

Generic operators defined by user-provided closures.

input

Create new Streams connected to external inputs.

inspect

Extension trait and implementation for observing and action on streamed data.

map

Extension methods for Stream based on record-by-record transformation.

ok_err

Operators that separate one stream into two streams based on some condition

partition

Partition a stream of records into multiple streams.

probe

Monitor progress at a Stream.

rc

Shared containers

reclock

Extension methods for Stream based on record-by-record transformation.

result

Extension methods for Stream containing Results.

to_stream

Conversion to the Stream type from iterators.

unordered_input

Create new Streams connected to external inputs.

Structs

ActivateCapability

Capability that activates on drop.

Capability

The capability to send data with a certain timestamp on a dataflow edge.

CapabilitySet

A set of capabilities, for possibly incomparable times.

DowngradeError

An error produced when trying to downgrade a capability with a time that’s not less than or equal to the current capability

InputCapability

An capability of an input port. Holding onto this capability will implicitly holds onto a capability for all the outputs ports this input is connected to, after the connection summaries have been applied.