Struct IteratorSource 

pub struct IteratorSource<It>
where
    It: Iterator + Send + 'static,
    It::Item: Send,
{ /* private fields */ }

Source that consumes an iterator and emits all its elements into the stream.

The iterator will be consumed only from one replica, therefore this source is not parallel.

Implementations

impl<It> IteratorSource<It>

where It: Iterator + Send + 'static, It::Item: Send,

pub fn new(inner: It) -> Self

Create a new source that reads the items from the iterator provided as input.

Note: this source is not parallel, the iterator will be consumed only on a single replica, on all the others no item will be read from the iterator. If you want to achieve parallelism you need to add an operator that shuffles the data (e.g. Stream::shuffle).

Example

let source = IteratorSource::new((0..5));
let s = env.stream(source);

Trait Implementations

impl<It> Clone for IteratorSource<It>

where It: Iterator + Send + 'static, It::Item: Send,

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<It> Debug for IteratorSource<It>

where It: Iterator + Send + 'static, It::Item: Send,

fn fmt(&self, __f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<It> Display for IteratorSource<It>

where It: Iterator + Send + 'static, It::Item: Send,

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<It> Operator for IteratorSource<It>

where It: Iterator + Send + 'static, It::Item: Send,

type Out = <It as Iterator>::Item

fn setup(&mut self, _metadata: &mut ExecutionMetadata<'_>)

Setup the operator chain. This is called before any call to next and it’s used to initialize the operator. When it’s called the operator has already been cloned and it will never be cloned again. Therefore it’s safe to store replica-specific metadata inside of it.

fn next(&mut self) -> StreamElement<Self::Out>

Take a value from the previous operator, process it and return it.

fn structure(&self) -> BlockStructure

A more refined representation of the operator and its predecessors.

impl<It> Source for IteratorSource<It>

where It: Iterator + Send + 'static, It::Item: Send,

fn replication(&self) -> Replication

The maximum parallelism offered by this operator.