Struct BatchProvider 

pub struct BatchProvider { /* private fields */ }

A batch of input feature sets for bulk prediction.

Wraps MLArrayBatchProvider to collect multiple input sets that can be submitted to Model::predict_batch in a single call.

Example

let inputs_0: &[(&str, &dyn AsMultiArray)] = &[("x", &tensor_a)];
let inputs_1: &[(&str, &dyn AsMultiArray)] = &[("x", &tensor_b)];
let batch = BatchProvider::new(&[&inputs_0[..], &inputs_1[..]])?;
assert_eq!(batch.count(), 2);

Implementations

impl BatchProvider

pub fn new(inputs: &[&[(&str, &dyn AsMultiArray)]]) -> Result<Self>

Create a batch provider from a slice of named input sets.

Each element in inputs is a complete set of named tensors for one prediction.

pub fn count(&self) -> usize

Returns the number of input sets in this batch.

Trait Implementations

impl Debug for BatchProvider

Available on Apple only.

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Send for BatchProvider

Available on Apple only.