pub struct Report {Show 18 fields
pub suite_id: String,
pub seed: u64,
pub results: Vec<CaseResult>,
pub deterministic_failures: u64,
pub true_positives: u64,
pub false_positives: u64,
pub false_negatives: u64,
pub true_negatives: u64,
pub abstentions: u64,
pub input_tokens: u64,
pub output_tokens: u64,
pub total_latency_ms: u64,
pub precision: Option<f64>,
pub recall: Option<f64>,
pub false_positive_rate: Option<f64>,
pub estimated_cost_usd: Option<f64>,
pub blocks_release: bool,
pub semantic_false_blocks: u64,
}Expand description
Batch results and labeled-case confusion counts.
Fields§
§suite_id: StringSuite ID.
seed: u64Fixed fixture seed.
results: Vec<CaseResult>Per-case assessments.
deterministic_failures: u64Failed factual assertions, independent of model output.
true_positives: u64True positives among labeled semantic regressions.
false_positives: u64False positives among labeled semantic regressions.
false_negatives: u64False negatives among labeled semantic regressions.
true_negatives: u64True negatives among labeled semantic regressions.
abstentions: u64Provider unavailable or low-confidence count.
input_tokens: u64Total provider token usage, if replayed responses contain usage.
output_tokens: u64Total provider output tokens.
total_latency_ms: u64Sum of measured provider durations.
precision: Option<f64>Precision on labeled, non-abstained cases when defined.
recall: Option<f64>Recall on labeled, non-abstained cases when defined.
false_positive_rate: Option<f64>False positive rate on labeled, non-abstained cases when defined.
estimated_cost_usd: Option<f64>Estimated provider cost when both token prices are supplied.
blocks_release: boolAdvisory only; always false.
semantic_false_blocks: u64Number of releases blocked solely by model findings; always zero.
Trait Implementations§
Source§impl<'de> Deserialize<'de> for Report
impl<'de> Deserialize<'de> for Report
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Auto Trait Implementations§
impl Forget for Report
impl Freeze for Report
impl Move for Report
impl RefUnwindSafe for Report
impl Send for Report
impl Sync for Report
impl Unpin for Report
impl UnsafeUnpin for Report
impl UnwindSafe for Report
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more