Struct MlxBufferPool 

pub struct MlxBufferPool<'d> { /* private fields */ }

Arena-style buffer pool that reuses Metal buffer allocations.

Design

• Buffers are bucketed by their allocated size rounded up to the nearest power of two. This reduces fragmentation at the cost of occasionally over-allocating by up to 2x.
• release() returns a single buffer; reset() returns all outstanding buffers.
• The pool holds a reference to the MlxDevice so it can allocate fresh buffers when the free list is empty.

Implementations

impl<'d> MlxBufferPool<'d>

pub fn new(device: &'d MlxDevice) -> Self

Create a new empty buffer pool backed by the given device.

pub fn alloc( &mut self, byte_len: usize, dtype: DType, shape: Vec<usize>, ) -> Result<MlxBuffer>

Allocate a buffer from the pool.

If a free buffer of compatible size exists in the pool, it is reused (with updated dtype/shape metadata). Otherwise a new Metal buffer is allocated from the device.

The actual Metal buffer size will be rounded up to the nearest power of two for bucketing purposes.

pub fn release(&mut self, buffer: MlxBuffer)

Return a buffer to the pool’s free list for future reuse.

The Metal memory is not deallocated — it stays resident on the GPU for fast reuse.

pub fn free_count(&self) -> usize

Return all free buffers’ count (for diagnostics).

pub fn free_bytes(&self) -> usize

Total number of bytes held in the free list.

pub fn clear(&mut self)

Clear all free buffers, releasing Metal memory.