Struct BatchProcessor 

pub struct BatchProcessor { /* private fields */ }

Batch processor for parallel input processing

When scirs2-core parallel features are available, uses multi-threaded processing. Falls back to sequential processing otherwise.

Implementations

impl BatchProcessor

pub fn new() -> Self

Create a new batch processor with automatic thread count

pub fn with_threads(num_threads: usize) -> Self

Create a batch processor with specific thread count

pub fn num_threads(&self) -> usize

Get the number of threads

pub fn process_batch<F, T, R>(&self, inputs: &[T], f: F) -> Vec<R>

where F: Fn(&T) -> R,

Process a batch of inputs

Uses parallel processing via scirs2-core when available.

pub fn process_layers_parallel<F, R>(&self, num_layers: usize, f: F) -> Vec<R>

where F: Fn(usize) -> R,

Process multiple layers

For independent layer computations (e.g., different attention heads). Sequential layer dependencies still require sequential processing.

Trait Implementations

impl Debug for BatchProcessor

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for BatchProcessor

fn default() -> Self

Returns the “default value” for a type.