Struct TensorArena 

pub struct TensorArena {
    pub regions: Vec<ArenaRegion>,
    pub region_size: usize,
    pub stats: ArenaStats,
}

Bump-allocating arena for inference-pipeline tensors.

Allocations are O(1) — a bump pointer is incremented and, when a region is exhausted, a new fixed-size region is appended. Freeing all tensors is O(regions) via reset_all.

Fields

regions: Vec<ArenaRegion>

All memory regions, ordered by creation time.

region_size: usize

Default size (bytes) for each new region.

stats: ArenaStats

Cumulative statistics.

Implementations

impl TensorArena

pub fn new(region_size: usize) -> Self

Construct a new arena whose regions will be region_size bytes each.

pub fn allocate(&mut self, size: usize) -> ArenaSlice

Allocate size bytes from the arena and return an ArenaSlice.

If the current (last) region cannot satisfy the request a new region is created. size is always rounded up to the next multiple of ARENA_ALIGN internally.

pub fn reset_all(&mut self)

Reset every region’s bump pointer, allowing all memory to be reused.

Outstanding ArenaSlice handles become stale after this call.

pub fn region_count(&self) -> usize

Number of regions (slabs) currently held.

pub fn total_capacity(&self) -> u64

Total capacity in bytes across all regions.

pub fn total_used(&self) -> u64

Total bytes that have been bump-allocated (not yet reset).

pub fn utilization(&self) -> f64

Overall utilization as total_used / total_capacity.

Returns 0.0 if there are no regions.