Module monitoring

Expand description

§Optimizer Monitoring and Analysis Tools

This module provides tools for monitoring optimizer performance, tracking metrics, and diagnosing optimization issues during training.

Optimizer State Tracking: Monitor learning rates, gradient norms, parameter changes
Convergence Analysis: Track loss trends, detect plateaus, measure convergence rates
Performance Profiling: Measure optimizer overhead and memory usage
Debugging Tools: Detect gradient explosions, vanishing gradients, oscillations

ConvergenceIndicators: Convergence analysis indicators.
HyperparameterSensitivity: Main hyperparameter sensitivity analyzer.
HyperparameterSensitivityConfig: Configuration for hyperparameter sensitivity analysis.
HyperparameterSensitivityMetrics: Sensitivity metrics for a specific hyperparameter.
MemoryStats: Memory usage statistics.
MetricStats: Statistics for a single metric over time.
MonitoringConfig: Configuration for optimizer monitoring.
OptimizerMetrics: Comprehensive optimizer monitoring data.
OptimizerMonitor: Main optimizer monitor that tracks various metrics.
OptimizerRecommendation: Optimizer recommendation with performance characteristics
OptimizerSelector: Optimizer Performance Analysis and Selection Tool
PerformanceStats: Performance monitoring data.