pub enum TuneObjective {
Mrr,
Top1,
CoveredMrr,
Top1AtMinCoverage,
SuccessWeightedMrr,
SuccessWeightedTop1,
}Expand description
Which held-out metric tune ranks candidates by. See each variant’s
doc comment; CoveredMrr is the recommended default – optimizing Mrr
alone tends to pick configs that abstain (report no candidate) except
when very confident, while optimizing coverage alone tolerates a sloppy
prior. CoveredMrr penalizes both.
Variants§
Mrr
mean_reciprocal_rank, among evaluated (covered) test observations only.
Top1
top1_hit_rate, among evaluated (covered) test observations only.
CoveredMrr
covered_fraction * mean_reciprocal_rank – MRR averaged across
all test observations, treating an uncovered one as contributing 0.
Top1AtMinCoverage
Identical to Top1; choosing this objective requires
TuneConstraints::min_covered_fraction to also be set, so the
coverage floor lives in one place (constraints) instead of being
duplicated inside the objective itself.
SuccessWeightedMrr
EvalReport::success_weighted_mean_reciprocal_rank – like Mrr, but
a failed or unrecorded-outcome test observation contributes nothing,
so this favors configs that agree with actions that actually worked.
SuccessWeightedTop1
EvalReport::success_weighted_top1_hit_rate, the same idea applied
to Top1.
Trait Implementations§
Source§impl Clone for TuneObjective
impl Clone for TuneObjective
Source§fn clone(&self) -> TuneObjective
fn clone(&self) -> TuneObjective
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read more