pub struct CPUOffloadConfig {
pub offload_optimizer_states: bool,
pub offload_gradients: bool,
pub offload_parameters: bool,
pub overlap_transfers: bool,
pub pin_memory: bool,
pub offload_threshold: usize,
}Expand description
Configuration for CPU offloading behavior.
Fields§
§offload_optimizer_states: boolWhether to offload optimizer states to CPU
offload_gradients: boolWhether to offload gradients to CPU during backward pass
offload_parameters: boolWhether to offload parameters when not in use
overlap_transfers: boolOverlap CPU-GPU transfers with computation
pin_memory: boolPin CPU memory for faster transfers
offload_threshold: usizeThreshold for tensor size to offload (bytes)
Trait Implementations§
Source§impl Clone for CPUOffloadConfig
impl Clone for CPUOffloadConfig
Source§fn clone(&self) -> CPUOffloadConfig
fn clone(&self) -> CPUOffloadConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for CPUOffloadConfig
impl Debug for CPUOffloadConfig
Source§impl Default for CPUOffloadConfig
impl Default for CPUOffloadConfig
Source§impl<'de> Deserialize<'de> for CPUOffloadConfig
impl<'de> Deserialize<'de> for CPUOffloadConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for CPUOffloadConfig
impl RefUnwindSafe for CPUOffloadConfig
impl Send for CPUOffloadConfig
impl Sync for CPUOffloadConfig
impl Unpin for CPUOffloadConfig
impl UnwindSafe for CPUOffloadConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> ConfigSerializable for Twhere
T: Serialize + for<'de> Deserialize<'de>,
impl<T> ConfigSerializable for Twhere
T: Serialize + for<'de> Deserialize<'de>,
Source§fn save_to_file(&self, path: &Path) -> Result<(), TrustformersError>
fn save_to_file(&self, path: &Path) -> Result<(), TrustformersError>
Save to file
Source§fn load_from_file(path: &Path) -> Result<Self, TrustformersError>where
Self: Sized,
fn load_from_file(path: &Path) -> Result<Self, TrustformersError>where
Self: Sized,
Load from file
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more