Struct KFACConfig 

pub struct KFACConfig<T: Float + Debug + Send + Sync + 'static> {
    pub learning_rate: T,
    pub damping: T,
    pub weight_decay: T,
    pub cov_update_freq: usize,
    pub inv_update_freq: usize,
    pub stat_decay: T,
    pub min_eigenvalue: T,
    pub max_inv_iterations: usize,
    pub inv_tolerance: T,
    pub use_tikhonov: bool,
    pub auto_damping: bool,
    pub target_acceptance_ratio: T,
}

K-FAC optimizer configuration

Fields

learning_rate: T

Learning rate

damping: T

Damping parameter for numerical stability

weight_decay: T

Weight decay (L2 regularization)

cov_update_freq: usize

Update frequency for covariance matrices

inv_update_freq: usize

Update frequency for inverse covariance matrices

stat_decay: T

Exponential moving average decay for statistics

min_eigenvalue: T

Minimum eigenvalue for regularization

max_inv_iterations: usize

Maximum number of iterations for iterative inversion

inv_tolerance: T

Tolerance for iterative inversion

use_tikhonov: bool

Use Tikhonov regularization

auto_damping: bool

Enable automatic damping adjustment

target_acceptance_ratio: T

Target acceptance ratio for damping adjustment

Implementations

impl<T: Float + Debug + Send + Sync + 'static> KFACConfig<T>

pub fn for_large_model() -> Self

Create configuration optimized for large models

pub fn for_small_model() -> Self

Create configuration optimized for small models with frequent updates

pub fn for_stability() -> Self

Create configuration with conservative damping for stability

pub fn validate(&self) -> Result<(), String>

Validate configuration parameters

Trait Implementations

impl<T: Clone + Float + Debug + Send + Sync + 'static> Clone for KFACConfig<T>

fn clone(&self) -> KFACConfig<T>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<T: Debug + Float + Debug + Send + Sync + 'static> Debug for KFACConfig<T>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<T: Float + Debug + Send + Sync + 'static> Default for KFACConfig<T>

fn default() -> Self

Returns the “default value” for a type.