Struct MuonAdamWConfig 

pub struct MuonAdamWConfig { /* private fields */ }

Muon for explicitly selected hidden matrices and AdamW for the remainder.

Optimizer::step(lr, ...) uses lr for Muon and lr * adamw_lr_ratio for AdamW. try_step_with_lrs accepts independent rates instead. This is a high-level tensor optimizer, not the experimental fused AdamW API.

Implementations

impl MuonAdamWConfig

pub fn new() -> Self

Create a new instance of the config.

Arguments

Default Arguments

muon

Muon settings, with legacy numerical defaults preserved.

• Defaults to "MuonConfig::new()"

adamw

Settings for all parameters not explicitly selected for Muon.

• Defaults to "AdamWConfig::new()"

adamw_lr_ratio

AdamW/Muon learning-rate ratio. 0.015 maps 0.02 to 0.0003.

• Defaults to 0.015

impl MuonAdamWConfig

pub fn with_muon(self, muon: MuonConfig) -> Self

Sets the value for the field muon.

Muon settings, with legacy numerical defaults preserved.

• Defaults to "MuonConfig::new()"

pub fn with_adamw(self, adamw: AdamWConfig) -> Self

Sets the value for the field adamw.

Settings for all parameters not explicitly selected for Muon.

• Defaults to "AdamWConfig::new()"

pub fn with_adamw_lr_ratio(self, adamw_lr_ratio: f64) -> Self

Sets the value for the field adamw_lr_ratio.

AdamW/Muon learning-rate ratio. 0.015 maps 0.02 to 0.0003.

• Defaults to 0.015

impl MuonAdamWConfig

pub fn init<B: AutodiffBackend, M: AutodiffModule<B>>( &self, module: &M, muon_parameters: &[ParamId], ) -> Result<MuonAdamW<M, B>, MuonError>

Validate configuration and resolve selected parameter IDs against a model. Do not select embeddings, output heads, normalization gains or biases.

Trait Implementations

impl Clone for MuonAdamWConfig

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Config for MuonAdamWConfig

fn save<P>(&self, file: P) -> Result<(), Error>

where P: AsRef<Path>,

Available on crate feature std only.

Saves the configuration to a file.

fn load<P>(file: P) -> Result<Self, ConfigError>

where P: AsRef<Path>,

Available on crate feature std only.

Loads the configuration from a file.

fn load_binary(data: &[u8]) -> Result<Self, ConfigError>

Loads the configuration from a binary buffer.

impl Debug for MuonAdamWConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for MuonAdamWConfig

fn deserialize<D>(deserializer: D) -> Result<Self, D::Error>

where D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Display for MuonAdamWConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Serialize for MuonAdamWConfig

fn serialize<S>(&self, serializer: S) -> Result<S::Ok, S::Error>

where S: Serializer,

Serialize this value into the given Serde serializer.