Module timely::dataflow::operators [] [src]

Extension traits for Stream implementing various operators.

A collection of functions taking typed Stream objects as input and producing new Stream objects as output. Many of the operators provide simple, composable functionality. Some of the operators are more complicated, for use with advanced timely dataflow features.

The Unary and Binary operators provide general operators whose behavior can be supplied using closures accepting input and output handles. Most of the operators in this module are defined using these two general operators.

Reexports

pub use self::enterleave::Enter;
pub use self::enterleave::EnterAt;
pub use self::enterleave::Leave;
pub use self::unary::Unary;
pub use self::input::Input;
pub use self::unordered_input::UnorderedInput;
pub use self::feedback::LoopVariable;
pub use self::feedback::ConnectLoop;
pub use self::concat::Concat;
pub use self::concat::Concatenate;
pub use self::partition::Partition;
pub use self::map::Map;
pub use self::inspect::Inspect;
pub use self::filter::Filter;
pub use self::binary::Binary;
pub use self::delay::Delay;
pub use self::exchange::Exchange as ExchangeExtension;
pub use self::broadcast::Broadcast;
pub use self::probe::Probe;
pub use self::to_stream::ToStream;
pub use self::capture::Capture;
pub use self::operator::Operator;
pub use self::reclock::Reclock;
pub use self::count::Accumulate;

Modules

aggregation

Aggregation operators of various flavors

binary

Methods to construct generic streaming and blocking binary operators.

broadcast

Broadcast records to all workers.

capture

Operators which capture and replay streams of records.

concat

Merges the contents of multiple streams.

count

Counts the number of records at each time.

delay

Operators acting on timestamps to logically delay records

enterleave

Extension traits to move a Stream between an outer Scope and inner Scope.

exchange

Exchange records between workers.

feedback

Create cycles in a timely dataflow graph.

filter

Filters a stream by a predicate.

input

Create new Streams connected to external inputs.

inspect

Extension trait and implementation for observing and action on streamed data.

map

Extension methods for Stream based on record-by-record transformation.

operator

Methods to construct generic streaming and blocking unary operators.

partition

Partition a stream of records into multiple streams.

probe

Monitor progress at a Stream.

reclock

Extension methods for Stream based on record-by-record transformation.

to_stream

Conversion to the Stream type from iterators.

unary

Methods to construct generic streaming and blocking unary operators.

unordered_input

Create new Streams connected to external inputs.

Structs

Capability

The capability to send data with a certain timestamp on a dataflow edge.

CapabilitySet

A set of capabilities, for possibly incomparable times.

FrontierNotificator

Tracks requests for notification and delivers available notifications.

FrontieredInputHandle

Handle to an operator's input stream and frontier.

InputHandle

Handle to an operator's input stream.

Notificator

Tracks requests for notification and delivers available notifications.

OutputHandle

Handle to an operator's output stream.