Enum PersistentMemory 

pub enum PersistentMemory {
    Enabled,
    SizeMatch,
    Disabled,
    Enforced,
}

Configuration options for persistent memory pools in CubeCL runtimes.

Variants

Enabled

Persistent memory is enabled but used only when explicitly specified.

SizeMatch

Like enabled, and automatic allocations whose size matches an existing persistent bucket are also served from the persistent pool.

A good heuristic for training, where the recurring allocations are weight-shaped and updated within the same pool. Less suited to inference: activations that happen to match a weight size get pulled into exact-sized persistent slices.

Disabled

Persistent memory is disabled, allowing dynamic allocations.

Enforced

Persistent memory is enforced, preventing dynamic allocations.

Warning

Enforcing persistent memory may cause out-of-memory errors if tensors of varying sizes are used.

Trait Implementations

impl Clone for PersistentMemory

fn clone(&self) -> PersistentMemory

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PersistentMemory

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for PersistentMemory

fn default() -> PersistentMemory

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for PersistentMemory

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for PersistentMemory

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.