pub enum Optimizer {
Show 19 variants
AdamW,
AdamW8bit,
Adafactor,
DAdaptation,
DAdaptationGrad,
DAdaptAdam,
DAdaptAdan,
DAdaptAdamIP,
DAdaptAdamReprint,
DAdaptLion,
DAdaptSGD,
Lion,
Lion8bit,
PagedAdamW8bit,
PagedAdamW32bit,
PagedLion8bit,
Prodigy,
SGDNesterov,
SGDNesterov8bit,
}Expand description
The optimizer to use for the training process.
Variants§
AdamW
AdamW optimizer.
AdamW8bit
AdamW 8-bit optimizer.
Adafactor
Adafactor optimizer.
DAdaptation
DAdaptation optimizer.
DAdaptationGrad
DAdaptationGrad optimizer.
DAdaptAdam
DAdaptAdam optimizer.
DAdaptAdan
DAdaptAdan optimizer.
DAdaptAdamIP
DAdaptAdamIP optimizer.
DAdaptAdamReprint
DAdaptAdamReprint optimizer.
DAdaptLion
DAdaptLion optimizer.
DAdaptSGD
DAdaptSGD optimizer.
Lion
Lion optimizer.
Lion8bit
Lion 8-bit optimizer.
PagedAdamW8bit
PagedAdamW 8-bit optimizer.
PagedAdamW32bit
PagedAdamW 32-bit optimizer.
PagedLion8bit
PagedLion 8-bit optimizer.
Prodigy
Prodigy optimizer.
SGDNesterov
SGDNesterov optimizer.
SGDNesterov8bit
SGDNesterov 8-bit optimizer.
Trait Implementations§
Source§impl<'de> Deserialize<'de> for Optimizer
impl<'de> Deserialize<'de> for Optimizer
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for Optimizer
impl RefUnwindSafe for Optimizer
impl Send for Optimizer
impl Sync for Optimizer
impl Unpin for Optimizer
impl UnwindSafe for Optimizer
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more