Struct TensorPool 

pub struct TensorPool { /* private fields */ }

Slab-based, thread-safe buffer pool for zero-copy Arrow IPC tensor operations.

Internally maintains 8 free lists — one per power-of-two size class from 256 B to 32 MiB. All free lists are protected by individual Mutex locks so contention is minimised.

Thread Safety

TensorPool is Send + Sync and can be wrapped in an Arc for sharing across threads / async tasks.

Implementations

impl TensorPool

pub fn new(config: TensorPoolConfig) -> Self

Create a new TensorPool with the supplied configuration.

pub fn acquire(&self, min_bytes: usize) -> PooledBuffer

Acquire a buffer whose capacity is at least min_bytes.

If the corresponding free list is non-empty, a buffer is popped and returned (incrementing total_reuses). Otherwise a fresh Vec<u8> is allocated (incrementing total_allocs).

In both cases total_acquired is incremented.

pub fn release(&self, buf: PooledBuffer)

Release a buffer back into the pool.

The buffer contents are cleared (length reset to 0, capacity retained) before being added to the free list. If the free list for the buffer’s bucket already holds max_per_bucket entries, the buffer is simply dropped (freeing its memory).

Increments total_released in both cases. Adjusts total_bytes_pooled by the buffer’s capacity when it is successfully pooled.

pub fn pool_depth(&self, bucket: usize) -> usize

Return the number of free (available) buffers in the specified bucket.

Panics

Panics in debug mode if bucket >= NUM_BUCKETS.

pub fn stats(&self) -> TensorPoolSnapshot

Capture a snapshot of the pool statistics.

pub fn prune(&self, max_per_bucket: usize)

Drain excess buffers from every bucket, keeping at most max_per_bucket buffers per bucket.

Buffers that are drained are dropped, releasing their memory. The total_bytes_pooled counter is decremented accordingly.

Trait Implementations

impl Default for TensorPool

fn default() -> Self

Returns the “default value” for a type.