pub struct CostEfficiency {
pub mean_cost_per_attempt: Option<f64>,
pub cost_per_solve: Option<f64>,
pub mean_tokens_per_attempt: Option<f64>,
pub mean_turns_per_attempt: Option<f64>,
}Expand description
Cost-efficiency aggregates for a suite (HarnessTax-style frontier metrics).
Unknown pricing is never treated as zero: any unpriced attempt makes
cost_per_solve None so the report cannot claim a complete cost basis.
Fields§
§mean_cost_per_attempt: Option<f64>§cost_per_solve: Option<f64>§mean_tokens_per_attempt: Option<f64>§mean_turns_per_attempt: Option<f64>Implementations§
Source§impl CostEfficiency
impl CostEfficiency
Sourcepub fn from_runs<'a>(
results: impl IntoIterator<Item = &'a EvalRunResult>,
) -> Self
pub fn from_runs<'a>( results: impl IntoIterator<Item = &'a EvalRunResult>, ) -> Self
Compute efficiency metrics from attempt results.
cost_usd / trace_summary come from each EvalRunResult. Token and
turn means use only attempts that carry a trace summary.
Trait Implementations§
Source§impl Clone for CostEfficiency
impl Clone for CostEfficiency
impl Copy for CostEfficiency
Source§impl Debug for CostEfficiency
impl Debug for CostEfficiency
Source§impl Default for CostEfficiency
impl Default for CostEfficiency
Source§impl PartialEq for CostEfficiency
impl PartialEq for CostEfficiency
impl StructuralPartialEq for CostEfficiency
Auto Trait Implementations§
impl Freeze for CostEfficiency
impl RefUnwindSafe for CostEfficiency
impl Send for CostEfficiency
impl Sync for CostEfficiency
impl Unpin for CostEfficiency
impl UnsafeUnpin for CostEfficiency
impl UnwindSafe for CostEfficiency
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more