pub struct DistillationConfig {
pub enabled: bool,
pub teacher_weight: f64,
pub student_weight: f64,
pub temperature: f64,
pub feature_matching_weight: f64,
pub attention_transfer_weight: f64,
}Expand description
Knowledge distillation configuration
Fields§
§enabled: boolEnable knowledge distillation
teacher_weight: f64Teacher model weight in loss function
student_weight: f64Student model weight in loss function
temperature: f64Temperature for distillation softmax
feature_matching_weight: f64Feature matching weight
attention_transfer_weight: f64Attention transfer weight
Trait Implementations§
Source§impl Clone for DistillationConfig
impl Clone for DistillationConfig
Source§fn clone(&self) -> DistillationConfig
fn clone(&self) -> DistillationConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for DistillationConfig
impl Debug for DistillationConfig
Source§impl Default for DistillationConfig
impl Default for DistillationConfig
Source§impl<'de> Deserialize<'de> for DistillationConfig
impl<'de> Deserialize<'de> for DistillationConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for DistillationConfig
impl RefUnwindSafe for DistillationConfig
impl Send for DistillationConfig
impl Sync for DistillationConfig
impl Unpin for DistillationConfig
impl UnwindSafe for DistillationConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more