Struct MuonAdamWRecord 

pub struct MuonAdamWRecord<B: AutodiffBackend> { /* private fields */ }

Versioned optimizer record. Save the model record with it so ParamIds survive. Configuration and routing are checked on load; lower-precision record settings can round momentum, so use full-precision records for continuation comparisons.

Implementations

impl<B: AutodiffBackend> MuonAdamWRecord<B>

pub fn muon_state_count(&self) -> usize

Number of hidden-matrix momentum states saved.

pub fn adamw_state_count(&self) -> usize

Number of auxiliary AdamW parameter states saved.

Trait Implementations

impl<B: Clone + AutodiffBackend> Clone for MuonAdamWRecord<B>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<B: AutodiffBackend> Record<B> for MuonAdamWRecord<B>

type Item<S: PrecisionSettings> = (u32, String, Vec<(u64, Vec<usize>, bool, String)>, <HashMap<ParamId, AdaptorRecord<Muon<<B as AutodiffBackend>::InnerBackend>, B>> as Record<B>>::Item<S>, <HashMap<ParamId, AdaptorRecord<AdamW, B>> as Record<B>>::Item<S>)

Type of the item that can be serialized and deserialized.

fn into_item<S: PrecisionSettings>(self) -> Self::Item<S>

Convert the current record into the corresponding item that follows the given settings.

fn from_item<S: PrecisionSettings>( item: Self::Item<S>, device: &B::Device, ) -> Self

Convert the given item into a record.