pub struct DistillationParams {
pub temperature: f32,
pub alpha: f32,
pub beta: Option<f32>,
pub epochs: u32,
pub final_loss: Option<f32>,
}Expand description
Distillation hyperparameters (spec §6.3.2)
Fields§
§temperature: f32Temperature for softening distributions (typically 2.0-5.0)
alpha: f32Weight for soft vs hard loss (α in loss formula)
beta: Option<f32>For progressive: weight for hidden vs logit loss (β)
epochs: u32Training epochs for distillation
final_loss: Option<f32>Final distillation loss achieved
Trait Implementations§
Source§impl Clone for DistillationParams
impl Clone for DistillationParams
Source§fn clone(&self) -> DistillationParams
fn clone(&self) -> DistillationParams
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for DistillationParams
impl Debug for DistillationParams
Source§impl<'de> Deserialize<'de> for DistillationParams
impl<'de> Deserialize<'de> for DistillationParams
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for DistillationParams
impl RefUnwindSafe for DistillationParams
impl Send for DistillationParams
impl Sync for DistillationParams
impl Unpin for DistillationParams
impl UnsafeUnpin for DistillationParams
impl UnwindSafe for DistillationParams
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more