Struct AutoBatcher 

pub struct AutoBatcher<T: TensorElement> { /* private fields */ }

Automatic operation batcher

Implementations

impl<T: TensorElement + Copy + Add<Output = T> + Sub<Output = T> + Mul<Output = T> + Div<Output = T> + FloatElement + Send + Sync> AutoBatcher<T>

pub fn new() -> Self

Create a new auto-batcher with default configuration

pub fn with_config(config: BatchingConfig) -> Self

Create a new auto-batcher with custom configuration

pub fn submit(&self, op: BatchableOp<T>) -> Result<BatchHandle<T>>

Submit an operation for batching

pub fn flush(&self) -> Result<()>

Force execution of any pending batch

pub fn stats(&self) -> BatchingStats

Get batching statistics

pub fn reset_stats(&self)

Reset statistics

Trait Implementations

impl<T: TensorElement + Copy + Add<Output = T> + Sub<Output = T> + Mul<Output = T> + Div<Output = T> + FloatElement + Send + Sync> Default for AutoBatcher<T>

fn default() -> Self

Returns the “default value” for a type.