Enum PoolType 

pub enum PoolType {
    ExclusivePages {
        max_alloc_size: u64,
    },
    Direct {
        reclaim_at: Option<u64>,
    },
    SlicedPages {
        page_size: u64,
        max_slice_size: u64,
        max_pool_size: Option<u64>,
    },
}

The type of memory pool to use.

Variants

ExclusivePages

Use a memory where every allocation is a separate page.

Fields

max_alloc_size: u64

The minimum number of bytes to allocate in this pool.

Direct

Give every allocation its own device allocation, sized to the request and reused by exact size.

No carving at all, so it wastes only alignment padding. Worth it where padding matters more than allocation count — under a DryRun, where unresolved reservations never reach the driver at all, or on a device the workload barely fits.

Fields

reclaim_at: Option<u64>

Reserved bytes above which free slices are returned to the driver. A watermark rather than a budget; None reclaims only on an explicit cleanup.

SlicedPages

Use a memory where each allocation is a slice of a bigger allocation.

Fields

page_size: u64

The page size to allocate.

max_slice_size: u64

The maximum size of a slice to allocate in the pool.

max_pool_size: Option<u64>

Hard cap on the total bytes of pages this pool may hold.

The effective cap is floor(max_pool_size / page_size) whole pages. If max_pool_size < page_size, the page size is shrunk to the (alignment-rounded) cap so the budget is honored with a single page. When the cap is reached and no free slice fits after coalescing, reserving returns IoError PoolCapacityExceeded instead of silently growing. None (the previous behavior) keeps unbounded growth.

Note: runtimes that create one memory management per stream (CUDA, HIP) apply the cap per stream.

Trait Implementations

impl Clone for PoolType

fn clone(&self) -> PoolType

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PoolType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.