Module learned_optimizers

Module learned_optimizers 

Source
Expand description

Learned Optimizers Module

This module implements optimization algorithms that learn to optimize, including:

  • Meta-learning based optimizers that adapt to different problem types
  • Neural Architecture Search (NAS) systems
  • Transformer-based optimization enhancements
  • Few-shot learning for optimization
  • Adaptive neural optimizers
  • Learned hyperparameter tuning systems

Re-exports§

pub use adaptive_nas_system::*;
pub use adaptive_transformer_enhancement::*;
pub use few_shot_learning_enhancement::*;
pub use learned_hyperparameter_tuner::*;
pub use meta_learning_optimizer::*;
pub use neural_adaptive_optimizer::*;

Modules§

adaptive_nas_system
Adaptive Neural Architecture Search (NAS) System for Optimization
adaptive_transformer_enhancement
Adaptive Transformer Enhancement for Optimization
few_shot_learning_enhancement
Few-Shot Learning Enhancement for Optimization
learned_hyperparameter_tuner
Learned Hyperparameter Tuner
meta_learning_optimizer
Meta-Learning Optimizer
neural_adaptive_optimizer
Neural Adaptive Optimizer

Structs§

AdaptationStatistics
Statistics for tracking adaptation
LayerNorm
Layer normalization parameters
LearnedOptimizationConfig
Configuration for learned optimizers
MetaOptimizerState
Meta-optimizer state
OptimizationNetwork
Neural network for learned optimization
OptimizationProblem
Meta-learning problem specification
ProblemEncoder
Problem encoder for creating embeddings
TrainingTask
Training task for meta-learning

Enums§

ActivationType
Types of activation functions
ParameterDistribution
Parameter distribution for initialization

Traits§

LearnedOptimizer
Trait for learned optimizers

Functions§

learned_optimize
Convenience function for learned optimization
placeholder