Struct dyer::plugin::pipeline::PipeLine

pub struct PipeLine<'pl, I, C> where
    C: 'pl,
    I: Send + Sync + Debug + 'pl,  {
    pub open_pipeline: &'pl dyn Fn() -> LocalBoxFuture<'pl, &'pl Option<C>>,
    pub close_pipeline: &'pl dyn Fn() -> LocalBoxFuture<'pl, ()>,
    pub process_item: &'pl dyn Fn(&mut Arc<Mutex<Vec<I>>>) -> LocalBoxFuture<'_, ()>,
    pub process_yerr: &'pl dyn Fn(&mut Arc<Mutex<Vec<String>>>) -> LocalBoxFuture<'_, ()>,
}

the end of data flow, plugin that consume the extracted Entity, In general, the default method does nothing, and customization is requird to store the data. An example:

async fn process_item(items: &mut Arc<Mutex<Vec<I>>>) {
    let itms = items.lock().unwrap();
    for _ in itms.len() {
        itms.pop();
    }
    println!("consumed {} items", itms.len() )
}
let pipeline = PipeLine::builder().process_item(&|items: &mut Arc<Mutex<Vec<I>>>|
process_item(items).boxed_local() );

the member not specified is by default assigned to the default method

Fields

open_pipeline: &'pl dyn Fn() -> LocalBoxFuture<'pl, &'pl Option<C>>

close_pipeline: &'pl dyn Fn() -> LocalBoxFuture<'pl, ()>

process_item: &'pl dyn Fn(&mut Arc<Mutex<Vec<I>>>) -> LocalBoxFuture<'_, ()>

process_yerr: &'pl dyn Fn(&mut Arc<Mutex<Vec<String>>>) -> LocalBoxFuture<'_, ()>

Implementations

impl<'pl, I, C> PipeLine<'pl, I, C> where
    C: 'pl,
    I: Send + Sync + Debug + 'pl, 

pub fn builder() -> PipeLineBuilder<'pl, ((), (), (), ()), I, C>

Create a builder for building PipeLine. On the builder, call .open_pipeline(...)(optional), .close_pipeline(...)(optional), .process_item(...)(optional), .process_yerr(...)(optional) to set the values of the fields. Finally, call .build() to create the instance of PipeLine.