pub struct DdpConfig {Show 16 fields
pub mode: Option<String>,
pub policy: Option<String>,
pub backend: Option<String>,
pub anchor: Option<Value>,
pub max_anchor: Option<u32>,
pub overhead_target: Option<f64>,
pub divergence_threshold: Option<f64>,
pub max_batch_diff: Option<Value>,
pub speed_hint: Option<SpeedHint>,
pub partition_ratios: Option<Vec<f64>>,
pub progressive: Option<Value>,
pub max_grad_norm: Option<f64>,
pub lr_scale_ratio: Option<f64>,
pub snapshot_timeout: Option<u32>,
pub checkpoint_every: Option<u32>,
pub timeline: Option<bool>,
}Expand description
DDP configuration. Maps 1:1 to flodl DdpConfig / DdpRunConfig.
Fields§
§mode: Option<String>§policy: Option<String>§backend: Option<String>§anchor: Option<Value>“auto” or integer.
max_anchor: Option<u32>§overhead_target: Option<f64>§divergence_threshold: Option<f64>§max_batch_diff: Option<Value>null (unlimited) or integer.
speed_hint: Option<SpeedHint>§partition_ratios: Option<Vec<f64>>§progressive: Option<Value>“auto” or bool.
max_grad_norm: Option<f64>§lr_scale_ratio: Option<f64>§snapshot_timeout: Option<u32>§checkpoint_every: Option<u32>§timeline: Option<bool>Trait Implementations§
Source§impl<'de> Deserialize<'de> for DdpConfig
impl<'de> Deserialize<'de> for DdpConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for DdpConfig
impl RefUnwindSafe for DdpConfig
impl Send for DdpConfig
impl Sync for DdpConfig
impl Unpin for DdpConfig
impl UnsafeUnpin for DdpConfig
impl UnwindSafe for DdpConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more