pub enum MemoryOptimizationTechnique {
GradientAccumulation {
accumulation_steps: u32,
},
ActivationCheckpointing {
checkpoint_ratio: f32,
},
CpuOffloading {
offload_threshold: f32,
},
MemoryMapping {
page_size: usize,
},
ActivationCompression {
compression_ratio: f32,
},
SmartGC {
gc_threshold: f32,
gc_interval: Duration,
},
CrossNodePooling {
pool_size_mb: u64,
},
HierarchicalMemory {
levels: Vec<MemoryLevel>,
},
}Expand description
Memory optimization techniques
Variants§
GradientAccumulation
Gradient accumulation to reduce memory usage
ActivationCheckpointing
Activation checkpointing
CpuOffloading
CPU offloading for optimizer states
MemoryMapping
Memory-mapped parameters
ActivationCompression
Compressed activations
SmartGC
Smart garbage collection
CrossNodePooling
Memory pooling across nodes
HierarchicalMemory
Hierarchical memory management
Fields
§
levels: Vec<MemoryLevel>Trait Implementations§
Source§impl Clone for MemoryOptimizationTechnique
impl Clone for MemoryOptimizationTechnique
Source§fn clone(&self) -> MemoryOptimizationTechnique
fn clone(&self) -> MemoryOptimizationTechnique
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for MemoryOptimizationTechnique
impl Debug for MemoryOptimizationTechnique
Source§impl<'de> Deserialize<'de> for MemoryOptimizationTechnique
impl<'de> Deserialize<'de> for MemoryOptimizationTechnique
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl StructuralPartialEq for MemoryOptimizationTechnique
Auto Trait Implementations§
impl Freeze for MemoryOptimizationTechnique
impl RefUnwindSafe for MemoryOptimizationTechnique
impl Send for MemoryOptimizationTechnique
impl Sync for MemoryOptimizationTechnique
impl Unpin for MemoryOptimizationTechnique
impl UnsafeUnpin for MemoryOptimizationTechnique
impl UnwindSafe for MemoryOptimizationTechnique
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more