Struct DynamicEvalReport 

pub struct DynamicEvalReport {

    pub schema: String,
    pub dataset: DatasetId,
    pub evaluator_config: EvaluatorConfigId,
    pub task_family: TaskFamily,
    pub question_schema: QuestionSchema,
    pub artifact: ArtifactId,
    pub template: TemplateRef,
    pub capability: DynamicCapabilityId,
    pub split: Split,
    pub provenance: DatasetProvenance,
    pub calibration: CalibrationStatus,
    pub claim: QualityClaim,
    pub metrics: Vec<Metric>,
    pub incomparable: Vec<IncomparableCase>,
    pub gates: Vec<GateResult>,
    pub limitations: Vec<String>,
}

A dynamic evaluation report, rustev.dynamic-eval-report/1 (3.7).

Fields

schema: String

dataset: DatasetId

evaluator_config: EvaluatorConfigId

task_family: TaskFamily

question_schema: QuestionSchema

artifact: ArtifactId

template: TemplateRef

capability: DynamicCapabilityId

split: Split

provenance: DatasetProvenance

calibration: CalibrationStatus

Distributions are uncalibrated; no calibration artifact is bound.

claim: QualityClaim

metrics: Vec<Metric>

Coverage first, then abstention by reason, then accepted error, then class-appropriate metrics; the same again over adversarial cases.

incomparable: Vec<IncomparableCase>

Cases not compared, by case id, with the reason.

gates: Vec<GateResult>

limitations: Vec<String>

Trait Implementations

impl Clone for DynamicEvalReport

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DynamicEvalReport

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for DynamicEvalReport

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Document for DynamicEvalReport

const SCHEMA: &'static str = DYNAMIC_REPORT

The schema string this document carries (spec 002, 3.2.1).

const LIMITS: ParseLimits = RECORD_V1

The limit set its bytes are scanned against (spec 002, 3.2.5).

fn schema(&self) -> &str

The value of the document’s own schema field.

fn parse(bytes: &[u8]) -> Result<Self, DocumentError>

Scan, deserialize and check the schema string.

fn canonical(&self) -> Result<Vec<u8>, CanonicalError>

The canonical bytes (spec 002, 3.3.1).

fn record_canonical(&self) -> Result<Vec<u8>, CanonicalError>

where Self: PartialEq,

The record canonical bytes (spec 004, 5.6): the canonical bytes, with finite fractional numbers written in shortest round-trip form.

fn record_digest(&self) -> Result<ContentDigest, CanonicalError>

where Self: PartialEq,

sha256(SCHEMA || 0x00 || record canonical bytes) (spec 004, 3.1.6). Equal to the identity of an identified document.

impl PartialEq for DynamicEvalReport

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for DynamicEvalReport

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for DynamicEvalReport