Struct TensorPool 

pub struct TensorPool<T> { /* private fields */ }

Memory pool for reusing allocated tensors to avoid allocation/deallocation overhead

This pool maintains a collection of pre-allocated vectors that can be reused to avoid the overhead of memory allocation and deallocation in tight loops.

Implementations

impl<T: Clone + Default> TensorPool<T>

pub fn new(max_size: usize) -> Self

Create a new tensor pool

Arguments

• max_size - Maximum number of tensors to keep in the pool

pub fn get(&self, capacity: usize) -> Vec<T>

Get a tensor from the pool or allocate a new one

If a suitable tensor is available in the pool, it will be reused. Otherwise, a new tensor will be allocated.

pub fn return_tensor(&self, tensor: Vec<T>)

Return a tensor to the pool

The tensor will be stored in the pool for future reuse if there’s space.

pub fn pool_size(&self) -> usize

Get the number of tensors currently in the pool

pub fn clear(&self)

Clear all tensors from the pool