pub struct EvaluationReport {
pub dataset_name: String,
pub dataset_version: String,
pub candidate_version: String,
pub execution_success_rate: f64,
pub cases: Vec<EvaluationCaseResult>,
pub summaries: Vec<EvaluationScoreSummary>,
}Expand description
Deterministic candidate evaluation report.
Fields§
§dataset_name: StringDataset name.
dataset_version: StringDataset version.
candidate_version: StringCandidate model, prompt, Agent, or application version.
execution_success_rate: f64Target executions that produced output.
cases: Vec<EvaluationCaseResult>Case results in dataset order.
summaries: Vec<EvaluationScoreSummary>Score summaries sorted by scorer name.
Implementations§
Source§impl EvaluationReport
impl EvaluationReport
Sourcepub fn to_json_pretty(&self) -> Result<String, Error>
pub fn to_json_pretty(&self) -> Result<String, Error>
Serializes this output-free report as stable, pretty JSON.
§Errors
Returns a JSON error only if serialization unexpectedly fails.
Sourcepub fn compare(
&self,
baseline: &Self,
policy: &RegressionPolicy,
) -> Result<RegressionComparison, EvaluationError>
pub fn compare( &self, baseline: &Self, policy: &RegressionPolicy, ) -> Result<RegressionComparison, EvaluationError>
Compares this candidate with a baseline of the same dataset identity.
§Errors
Returns EvaluationError::DatasetMismatch when dataset identities
differ.
Trait Implementations§
Source§impl Clone for EvaluationReport
impl Clone for EvaluationReport
Source§fn clone(&self) -> EvaluationReport
fn clone(&self) -> EvaluationReport
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for EvaluationReport
impl Debug for EvaluationReport
Source§impl<'de> Deserialize<'de> for EvaluationReport
impl<'de> Deserialize<'de> for EvaluationReport
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for EvaluationReport
impl PartialEq for EvaluationReport
Source§impl Serialize for EvaluationReport
impl Serialize for EvaluationReport
impl StructuralPartialEq for EvaluationReport
Auto Trait Implementations§
impl Freeze for EvaluationReport
impl RefUnwindSafe for EvaluationReport
impl Send for EvaluationReport
impl Sync for EvaluationReport
impl Unpin for EvaluationReport
impl UnsafeUnpin for EvaluationReport
impl UnwindSafe for EvaluationReport
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more