List of all items

Structs

• OptimizerOptions
• OptimizerState
• ParamGroup
• ParamGroupBuilder
• ParamGroupState
• adabelief::AdaBelief
• adabound::AdaBound
• adadelta::AdaDelta
• adadelta::AdaDeltaBuilder
• adagrad::AdaGrad
• adagrad::AdaGradBuilder
• adahessian::AdaHessian
• adahessian::AdaHessianBuilder
• adam::Adam
• adam::AdamBuilder
• adam::AdamW
• adamax::AdaMax
• adamax::AdaMaxBuilder
• advanced::AdamState
• advanced::AdvancedAdam
• advanced::LAMB
• advanced::LambState
• advanced::Lookahead
• asgd::ASGD
• bayesian_optimization::BayesianOptConfig
• bayesian_optimization::BayesianOptResult
• bayesian_optimization::BayesianOptimizer
• bayesian_optimization::DataPoint
• bayesian_optimization::GaussianProcess
• bayesian_optimization::GaussianProcessConfig
• bayesian_optimization::test_functions::Branin
• bayesian_optimization::test_functions::Quadratic1D
• benchmarks::comparison::ComparisonResult
• benchmarks::comparison::OptimizerComparison
• benchmarks::core::BenchmarkConfig
• benchmarks::core::BenchmarkResult
• benchmarks::core::MemoryStats
• benchmarks::core::OptimizerBenchmarks
• benchmarks::core::StatisticalAnalysis
• benchmarks::domain_specific::CVBenchmarks
• benchmarks::domain_specific::NLPBenchmarks
• benchmarks::domain_specific::RLBenchmarks
• benchmarks::optimizer::OptimizerBenchmarks
• checkpointing::Checkpoint
• checkpointing::CheckpointConfig
• checkpointing::CheckpointManager
• checkpointing::CheckpointMetadata
• checkpointing::CheckpointStatistics
• checkpointing::CheckpointingOptimizer
• composition::ComposedOptimizer
• composition::CompositionBuilder
• composition::CompositionLevel
• composition::OptimizerMetrics
• continual_learning::EWCConfig
• continual_learning::EWCOptimizer
• continual_learning::MASConfig
• continual_learning::MASOptimizer
• continual_learning::SIConfig
• continual_learning::SIOptimizer
• cross_framework_validation::CrossFrameworkValidator
• cross_framework_validation::ValidationConfig
• cross_framework_validation::ValidationResult
• debugging::AnalysisReport
• debugging::AnalyzerConfig
• debugging::ConvergenceTracker
• debugging::GradientFlowPoint
• debugging::GradientStatistics
• debugging::HyperparameterSensitivity
• debugging::OptimizationRecommendation
• debugging::OptimizationStep
• debugging::OptimizerAnalyzer
• debugging::ParameterStatistics
• debugging::SensitivityReport
• debugging::SensitivityResult
• differential_privacy::ClippingStats
• differential_privacy::DPConfig
• differential_privacy::DPManager
• differential_privacy::DPState
• differential_privacy::PrivacySummary
• distributed::async_sgd::AsyncConfig
• distributed::async_sgd::AsyncSGD
• distributed::core::CommunicationHandle
• distributed::core::CommunicationStats
• distributed::core::DistributedConfig
• distributed::core::DistributedOptimizer
• distributed::core::GradientBucket
• distributed::elastic_sgd::ElasticAveragingSGD
• evolutionary_strategies::CMAES
• evolutionary_strategies::EvolutionResult
• evolutionary_strategies::EvolutionStrategy
• evolutionary_strategies::EvolutionaryConfig
• evolutionary_strategies::Individual
• evolutionary_strategies::OpenAIES
• evolutionary_strategies::test_functions::RosenbrockFitness
• evolutionary_strategies::test_functions::SphereFitness
• ftrl::FTRL
• ftrl::FTRLBuilder
• fused_kernels::FusedStats
• grad_accumulation::AccumulatingOptimizer
• grad_accumulation::GradientAccumulator
• gradient_free::GradientFreeConfig
• gradient_free::NelderMead
• gradient_free::OptimizationResult
• gradient_free::ParticleSwarmOptimizer
• gradient_free::RandomSearch
• gradient_free::test_functions::Rastrigin
• gradient_free::test_functions::Rosenbrock
• gradient_free::test_functions::Sphere
• green_ai::CarbonConsciousConfig
• green_ai::CarbonConsciousOptimizer
• green_ai::CarbonIntensity
• green_ai::EnergyAwareConfig
• green_ai::EnergyAwareOptimizer
• green_ai::EnergyMetrics
• green_ai::PowerCappedConfig
• green_ai::PowerCappedOptimizer
• hyperparameter_tuning::EarlyStoppingConfig
• hyperparameter_tuning::HyperparameterConfig
• hyperparameter_tuning::HyperparameterSpace
• hyperparameter_tuning::HyperparameterTuner
• hyperparameter_tuning::Trial
• hyperparameter_tuning::TuningConfig
• hyperparameter_tuning::TuningResults
• kfac::KFAC
• kfac::KFACBuilder
• lamb::LAMB
• lazy_updates::LazyUpdateConfig
• lazy_updates::LazyUpdateManager
• lazy_updates::LazyUpdateOptimizer
• lazy_updates::LazyUpdateStatistics
• lazy_updates::ParameterImportance
• lazy_updates::PendingUpdate
• lbfgs::LBFGS
• lion::Lion
• lion::LionBuilder
• lion::LionConfig
• lookahead::Lookahead
• low_precision::LowPrecisionOptimizer
• low_precision::StateStatistics
• lr_scheduler::BaseScheduler
• lr_scheduler::CosineAnnealingLR
• lr_scheduler::ExponentialLR
• lr_scheduler::OneCycleLR
• lr_scheduler::ReduceLROnPlateau
• lr_scheduler::SchedulerState
• lr_scheduler::StepLR
• lr_scheduler_additional::ConstantLR
• lr_scheduler_additional::CosineAnnealingWarmRestarts
• lr_scheduler_additional::CyclicLR
• lr_scheduler_additional::LinearLR
• lr_scheduler_additional::MultiStepLR
• lr_scheduler_additional::PolynomialLR
• lr_scheduler_enhanced::AdaptiveLRScheduler
• lr_scheduler_enhanced::AdaptiveSchedulerStats
• lr_scheduler_enhanced::CosineAnnealingWarmRestartsWithWarmup
• lr_scheduler_enhanced::PolynomialDecayWithWarmup
• memory_efficient::CircularBuffer
• memory_efficient::MemoryConfig
• memory_efficient::MemoryEfficientAdam
• memory_efficient::MemoryEfficientLBFGS
• memory_efficient::MemoryEfficientOptimizerBuilder
• memory_efficient::MemoryPool
• memory_mapped::MemoryMappedConfig
• memory_mapped::MemoryMappedFile
• memory_mapped::MemoryMappedOptimizer
• memory_mapped::MemoryMappedStateStorage
• memory_mapped::StorageStatistics
• mixed_precision::MixedPrecisionConfig
• mixed_precision::MixedPrecisionOptimizer
• nadam::NAdam
• nadam::NAdamBuilder
• natural_gradient::NaturalGradient
• natural_gradient::NaturalGradientBuilder
• neural_optimizer::NetworkWeights
• neural_optimizer::NeuralOptimizer
• neural_optimizer::NeuralOptimizerConfig
• neural_optimizer::NeuralOptimizerTrainer
• neural_optimizer::OptimizerNetwork
• neural_optimizer::QuadraticTask
• neural_optimizer::TrainingConfig
• neuromorphic::EventDrivenConfig
• neuromorphic::EventDrivenOptimizer
• neuromorphic::STDPConfig
• neuromorphic::STDPOptimizer
• neuromorphic::TemporalCreditConfig
• neuromorphic::TemporalCreditOptimizer
• newton_cg::NewtonCG
• newton_cg::NewtonCGBuilder
• newton_cg::NewtonCGConfig
• numerical_stability_tests::NumericalStabilityTests
• numerical_stability_tests::StabilityTestConfig
• numerical_stability_tests::StabilityTestResult
• online_learning::OnlineGradientDescent
• online_learning::ProximalGradient
• online_learning::SAGA
• online_learning::SVRG
• optimizer::BaseOptimizer
• prodigy::Prodigy
• prodigy::ProdigyBuilder
• prodigy::ProdigyConfig
• quantum_inspired::QuantumAnnealing
• quantum_inspired::QuantumGeneticAlgorithm
• quantum_inspired::QuantumOptimizationResult
• quantum_inspired::QuantumPSO
• radam::RAdam
• ranger::RangerBuilder
• rmsprop::RMSprop
• rmsprop::RMSpropBuilder
• robustness::RobustnessConfig
• robustness::RobustnessManager
• robustness::RobustnessStats
• rprop::Rprop
• schedule_free::ScheduleFreeAdamW
• schedule_free::ScheduleFreeAdamWBuilder
• sgd::SGD
• sgd::SGDBuilder
• shampoo::Shampoo
• shampoo::ShampooBuilder
• sophia::Sophia
• sophia::SophiaBuilder
• sophia::SophiaConfig
• sparse_adam::SparseAdam
• sparse_updates::BlockSparseGradient
• sparse_updates::CompressionStats
• sparse_updates::OverallSparseStatistics
• sparse_updates::SparseGradient
• sparse_updates::SparsePatternStatistics
• sparse_updates::SparsePatternTracker
• sparse_updates::SparseUpdateConfig
• sparse_updates::SparseUpdateManager
• sparse_updates::SparseUpdateOptimizer
• state_dict_ops::CompressionStats
• state_dict_ops::MemoryEstimate
• state_dict_ops::StateDictConfig
• state_dict_ops::StateDictManager
• stress_tests::MemoryStats
• stress_tests::OptimizerStressTester
• stress_tests::StressTestConfig
• stress_tests::StressTestResult
• trust_region::TrustRegionBuilder
• trust_region::TrustRegionConfig
• trust_region::TrustRegionMethod
• yellowfin::YellowFin
• yellowfin::YellowFinBuilder
• yellowfin::YellowFinConfig

Enums

• OptimizerError
• bayesian_optimization::AcquisitionFunction
• bayesian_optimization::KernelType
• composition::CombinationMethod
• composition::CompositionStrategy
• composition::SwitchCriterion
• composition::VotingMethod
• debugging::RecommendationCategory
• debugging::Severity
• distributed::core::DistributedBackend
• distributed::core::SyncStrategy
• hyperparameter_tuning::AcquisitionFunction
• hyperparameter_tuning::HyperparameterValue
• hyperparameter_tuning::ObjectiveFunction
• hyperparameter_tuning::SearchStrategy
• lazy_updates::LazyUpdateDecision
• lazy_updates::UpdatePriority
• low_precision::LowPrecisionState
• low_precision::PrecisionType
• lr_scheduler_enhanced::AdaptiveStrategy
• lr_scheduler_enhanced::WarmupStrategy
• online_learning::ProximalOperator
• sparse_updates::SparseUpdateResult
• state_dict_ops::CompressionMethod
• state_dict_ops::SerializationFormat
• trust_region::SubproblemSolver
• trust_region::TrustRegionStrategy

Traits

• Optimizer
• bayesian_optimization::ObjectiveFunction
• checkpointing::CheckpointSupport
• differential_privacy::DifferentiallyPrivateOptimizer
• distributed::core::OptimizerExt
• evolutionary_strategies::FitnessFunction
• fused_kernels::FusedKernelSupport
• grad_accumulation::GradientAccumulationSupport
• gradient_free::ObjectiveFunction
• lazy_updates::LazyUpdateSupport
• low_precision::LowPrecisionConvertible
• lr_scheduler::LRScheduler
• memory_mapped::MemoryMappedSupport
• neural_optimizer::OptimizationTask
• robustness::RobustOptimizer
• sparse_updates::SparseUpdateSupport

Macros

• impl_base_scheduler_methods
• impl_scheduler_with_state

Functions

• benchmarks::utils::benchmark_scaling
• benchmarks::utils::create_comprehensive_config
• benchmarks::utils::create_test_config
• benchmarks::utils::generate_summary_report
• benchmarks::utils::run_domain_benchmarks
• benchmarks::utils::run_quick_benchmark_suite
• benchmarks::utils::run_quick_optimizer_comparison
• composition::utils::adaptive_switching
• composition::utils::equal_ensemble
• composition::utils::sequential_pipeline
• distributed::async_sgd::utils::create_async_sgd_distributed
• distributed::async_sgd::utils::global_staleness_stats
• distributed::async_sgd::utils::synchronize_async_sgd_workers
• distributed::elastic_sgd::utils::calculate_easgd_metrics
• distributed::elastic_sgd::utils::create_easgd_for_cluster_size
• distributed::elastic_sgd::utils::simulate_easgd_round
• distributed::utils::configs::cpu_mpi_config
• distributed::utils::configs::gpu_nccl_config
• distributed::utils::configs::large_scale_config
• distributed::utils::configs::low_bandwidth_config
• distributed::utils::configs::mixed_gloo_config
• distributed::utils::distributed_adam
• distributed::utils::distributed_optimizer
• distributed::utils::distributed_sgd
• distributed::utils::monitoring::aggregate_communication_stats
• distributed::utils::monitoring::collect_communication_stats
• distributed::utils::monitoring::print_performance_summary
• fused_kernels::fused_adadelta_step
• fused_kernels::fused_adagrad_step
• fused_kernels::fused_adam_step
• fused_kernels::fused_rmsprop_step
• fused_kernels::fused_sgd_step
• fused_kernels::utils::can_fuse_tensors
• fused_kernels::utils::estimate_bandwidth_savings
• fused_kernels::utils::supports_fused_ops
• grad_accumulation::with_gradient_accumulation
• hyperparameter_tuning::presets::adam_space
• hyperparameter_tuning::presets::rmsprop_space
• hyperparameter_tuning::presets::sgd_space
• lookahead::lookahead_adam
• lookahead::lookahead_radam
• lookahead::lookahead_sgd
• lr_scheduler_enhanced::utils::adaptive_accuracy_scheduler
• lr_scheduler_enhanced::utils::adaptive_loss_scheduler
• lr_scheduler_enhanced::utils::cosine_restart_with_warmup
• lr_scheduler_enhanced::utils::transformer_scheduler
• mixed_precision::utils::convert_to_fp16
• mixed_precision::utils::convert_to_fp32
• mixed_precision::utils::estimate_memory_savings
• mixed_precision::utils::supports_mixed_precision
• mixed_precision::with_mixed_precision
• numerical_stability_tests::run_comprehensive_stability_tests
• optimizer::functional::clip_grad_before_step
• state_dict_ops::utils::calculate_state_size
• state_dict_ops::utils::estimate_memory_usage
• state_dict_ops::utils::optimize_config_for_size

Type Aliases

• OptimizerResult
• ranger::Ranger

Constants

• VERSION
• VERSION_MAJOR
• VERSION_MINOR
• VERSION_PATCH