Struct TensorPool 

pub struct TensorPool { /* private fields */ }

A thread-safe memory pool for tensor buffers.

The pool maintains separate storage for different buffer configurations and automatically grows as needed. Buffers are returned to the pool when dropped.

Implementations

impl TensorPool

pub fn new() -> Self

Create a new tensor pool with default capacity (16 buffers per key).

pub fn with_capacity(max_buffers_per_key: usize) -> Self

Create a new tensor pool with specified maximum buffers per key.

pub fn acquire_f32(&self, key: BufferKey) -> InferenceResult<PooledBuffer<f32>>

Acquire a pooled f32 buffer.

pub fn acquire_f64(&self, key: BufferKey) -> InferenceResult<PooledBuffer<f64>>

Acquire a pooled f64 buffer.

pub fn clear(&self) -> InferenceResult<()>

Clear all pooled buffers.

pub fn stats(&self) -> InferenceResult<PoolStats>

Get pool statistics.

pub fn pooled_count(&self) -> InferenceResult<usize>

Get the current number of pooled buffers.

Trait Implementations

impl Clone for TensorPool

fn clone(&self) -> TensorPool

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Default for TensorPool

fn default() -> Self

Returns the “default value” for a type.