Struct BalancedSelector

pub struct BalancedSelector<I, O> { /* private fields */ }

Equally selects from N nodes that all take in the same input and give the same output

Example

use dataflow::prelude::*;

// Combine two file loading pipelines together, each taking Vec<()> as input and outputting Vec<(PathBuf, Vec<u8>)>
let combined_pipe = BalancedSelector::default()
    .add_node(FileLoader::new(vec!["file1".into()]))
    .add_node(FileLoader::new(vec!["file2".into()]).map(|(path, file)| {
        // Per-pipeline processing here
        (path, file)
    }));

Implementations

impl<I, O> BalancedSelector<I, O>

pub fn add_node<N: Node<Vec<I>, Output = Vec<O>> + 'static + Send>( self, node: N, ) -> Self

Trait Implementations

impl<I: Default, O: Default> Default for BalancedSelector<I, O>

fn default() -> BalancedSelector<I, O>

Returns the “default value” for a type.

impl<I, O> Node<Vec<I>> for BalancedSelector<I, O>

type Output = Vec<O>

fn process(&mut self, input: Vec<I>) -> Self::Output

Process a batch of data

fn data_remaining(&self, before: usize) -> usize

Get number of examples left

fn reset(&mut self)

Reset signal propogates through pipeline