Struct PoolAllocator 

pub struct PoolAllocator { /* private fields */ }

LRU memory pool for CPU tensor buffers.

Buffers are keyed by (numel, dtype). When a caller returns a buffer, it can be re-acquired on the next allocation of the same size, avoiding heap malloc/free on the hot path.

Implementations

impl PoolAllocator

pub fn new(capacity_bytes: usize) -> Self

pub fn acquire(&self, numel: usize, dtype: DType) -> Option<BufferHandle>

Try to acquire a buffer for numel elements of dtype. Returns None if the pool has no suitable entry — caller should allocate fresh.

pub fn release(&self, handle: BufferHandle, numel: usize, dtype: DType)

Return a buffer to the pool after use.

If the pool is over capacity, evict the least-recently-used entries.

pub fn used_bytes(&self) -> usize

Total bytes currently pooled.

pub fn capacity(&self) -> usize

Pool capacity in bytes.

Trait Implementations

impl Debug for PoolAllocator

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.