Enum MemoryConfiguration 

pub enum MemoryConfiguration {
    SubSlices,
    ExclusivePages,
    Custom {
        pool_options: Vec<MemoryPoolOptions>,
    },
}

High level configuration of memory management.

Variants

SubSlices

The default preset, which uses pools that allocate sub slices.

ExclusivePages

Default preset for using exclusive pages. This can be necessary for backends don’t support sub-slices.

Custom

Custom settings.

Fields

pool_options: Vec<MemoryPoolOptions>

Options for each pool to construct. When allocating, the first possible pool will be picked for an allocation.

Implementations

impl MemoryConfiguration

pub fn resolve( self, pools: Option<&MemoryPoolsConfig>, properties: &MemoryDeviceProperties, ) -> Result<Self, PoolConfigError>

Resolve a programmatic MemoryPoolsConfig override against the runtime-chosen configuration for the main GPU pool.

When pools is None, the runtime’s own self is kept unchanged; when present, it wins. There is deliberately no config-file pathway for pool layouts — they are dynamic (set per model just before a load) and must not freeze at startup; the override reaches the server through configure_memory_pools.

page_size is deliberately not validated against MemoryDeviceProperties::max_page_size: that value is a sizing heuristic for the default layouts (CUDA/HIP report a quarter of the device memory), not an allocation limit, and a large arena is exactly what an explicit pool override is for. An unallocatable page fails at allocation time.

Trait Implementations

impl Clone for MemoryConfiguration

fn clone(&self) -> MemoryConfiguration

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for MemoryConfiguration

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for MemoryConfiguration

fn default() -> Self

Returns the “default value” for a type.