Struct DistillationConfig 

pub struct DistillationConfig {
    pub temperature: f32,
    pub alpha: f32,
    pub learning_rate: f32,
    pub epochs: usize,
    pub batch_size: usize,
    pub matched_layers: HashMap<String, String>,
    pub use_feature_distillation: bool,
    pub feature_weight: f32,
}

Distillation configuration

Fields

temperature: f32

Temperature for softening probability distributions

alpha: f32

Weight for distillation loss vs task loss

learning_rate: f32

Learning rate for student model

epochs: usize

Number of training epochs

batch_size: usize

Batch size

matched_layers: HashMap<String, String>

Layers to match between teacher and student

use_feature_distillation: bool

Whether to use feature distillation

feature_weight: f32

Feature distillation weight

Trait Implementations

impl Clone for DistillationConfig

fn clone(&self) -> DistillationConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DistillationConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for DistillationConfig

fn default() -> Self

Returns the “default value” for a type.