Crate tpe[−][src]
Expand description
This crate provides a hyperparameter optimization algorithm using TPE (Tree-structured Parzen Estimator).
Examples
An example optimizing a simple quadratic function which has one numerical and one categorical parameters.
use rand::SeedableRng as _;
let choices = [1, 10, 100];
let mut optim0 =
tpe::TpeOptimizer::new(tpe::parzen_estimator(), tpe::range(-5.0, 5.0)?);
let mut optim1 =
tpe::TpeOptimizer::new(tpe::histogram_estimator(), tpe::categorical_range(choices.len())?);
fn objective(x: f64, y: i32) -> f64 {
x.powi(2) + y as f64
}
let mut best_value = std::f64::INFINITY;
let mut rng = rand::rngs::StdRng::from_seed(Default::default());
for _ in 0..100 {
let x = optim0.ask(&mut rng)?;
let y = optim1.ask(&mut rng)?;
let v = objective(x, choices[y as usize]);
optim0.tell(x, v)?;
optim1.tell(y, v)?;
best_value = best_value.min(v);
}
assert_eq!(best_value, 1.000054276671888);
References
Please refer to the following papers about the details of TPE:
Modules
Probability density function estimation.
Parameter range.
Structs
Optimizer using TPE.
Builder of TpeOptimizer
.
Enums
Possible errors during TpeOptimizerBuilder::build
.
Possible errors during TpeOptimizer::tell
.
Functions
Creates a Range
for a categorical parameter.
Creates a DefaultEstimatorBuilder
to build HistogramEstimator
(for numerical parameter).
Creates a DefaultEstimatorBuilder
to build ParzenEstimator
(for categorical parameter).