Struct EvalTask 

pub struct EvalTask {
    pub name: String,
    pub description: String,
    pub prompt: String,
    pub golden: String,
    pub assertions: Vec<Assertion>,
    pub weight: f64,
    pub required: bool,
}

A single eval task with prompt, golden answer, and assertions

Fields

name: String

Name of this task (used in reports)

description: String

Description of what this task tests

prompt: String

The prompt to send to the agent

golden: String

Expected golden answer (used for exact match scoring)

assertions: Vec<Assertion>

List of assertions to check against the response

weight: f64

Weight of this task in the overall score (0.0 - 1.0)

required: bool

Whether this task is required to pass (fails the suite if not)

Trait Implementations

impl Clone for EvalTask

fn clone(&self) -> EvalTask

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for EvalTask

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for EvalTask

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for EvalTask

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.