Module differential_dataflow::operators [] [src]

Timely dataflow operators specific to differential dataflow.

Differential dataflow introduces a small number of specialized operators, designed to apply to streams of typed updates, records of the form (T, Delta) indicating that the frequency of the associated record of type T has changed.

These operators have specialized implementations to make them work efficiently, but are in all other ways compatible with timely dataflow. In fact, many operators are currently absent because their timely dataflow analogues are sufficient (e.g. map, filter, concat).

Reexports

pub use self::group::Group;
pub use self::consolidate::ConsolidateExt;
pub use self::iterate::IterateExt;
pub use self::join::Join;
pub use self::threshold::Threshold;
pub use self::arrange::ArrangeByKey;
pub use self::arrange::ArrangeBySelf;

Modules

arrange

The arrange operator is used internally by differential to arrange a collection of (key,val) data by key, and present an Rc> to other operators that need the data ArrangedByKey this way.

consolidate

Aggregates the weights of equal records into at most one record.

group

Group records by a key, and apply a reduction function.

iterate

Iterative application of a differential dataflow fragment.

join

Match pairs of records based on a key.

threshold

An operator acting on (Key, ()) collections.