Expand description
Learned Optimizers Module
This module implements optimization algorithms that learn to optimize, including:
- Meta-learning based optimizers that adapt to different problem types
- Neural Architecture Search (NAS) systems
- Transformer-based optimization enhancements
- Few-shot learning for optimization
- Adaptive neural optimizers
- Learned hyperparameter tuning systems
Re-exports§
pub use adaptive_nas_system::*;
pub use adaptive_transformer_enhancement::*;
pub use few_shot_learning_enhancement::*;
pub use learned_hyperparameter_tuner::*;
pub use meta_learning_optimizer::*;
pub use neural_adaptive_optimizer::*;
Modules§
- adaptive_
nas_ system - Adaptive Neural Architecture Search (NAS) System for Optimization
- adaptive_
transformer_ enhancement - Adaptive Transformer Enhancement for Optimization
- few_
shot_ learning_ enhancement - Few-Shot Learning Enhancement for Optimization
- learned_
hyperparameter_ tuner - Learned Hyperparameter Tuner
- meta_
learning_ optimizer - Meta-Learning Optimizer
- neural_
adaptive_ optimizer - Neural Adaptive Optimizer
Structs§
- Adaptation
Statistics - Statistics for tracking adaptation
- Layer
Norm - Layer normalization parameters
- Learned
Optimization Config - Configuration for learned optimizers
- Meta
Optimizer State - Meta-optimizer state
- Optimization
Network - Neural network for learned optimization
- Optimization
Problem - Meta-learning problem specification
- Problem
Encoder - Problem encoder for creating embeddings
- Training
Task - Training task for meta-learning
Enums§
- Activation
Type - Types of activation functions
- Parameter
Distribution - Parameter distribution for initialization
Traits§
- Learned
Optimizer - Trait for learned optimizers
Functions§
- learned_
optimize - Convenience function for learned optimization
- placeholder