Struct EvalTestCase 

pub struct EvalTestCase {
    pub case_id: Uuid,
    pub inputs: Value,
    pub expected: Option<Value>,
    pub tags: Vec<String>,
}

A single test case within an evaluation suite.

Fields

case_id: Uuid

Unique identifier for this test case.

inputs: Value

Input provided to the agent.

expected: Option<Value>

Expected output (optional for scoring-based evals).

tags: Vec<String>

Tags for categorizing/filtering test cases.

Implementations

impl EvalTestCase

pub fn new(inputs: Value, expected: Option<Value>) -> Self

Create a new test case.

pub fn with_tag(self, tag: String) -> Self

Add a tag to this test case.

Trait Implementations

impl Clone for EvalTestCase

fn clone(&self) -> EvalTestCase

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for EvalTestCase

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for EvalTestCase

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for EvalTestCase

fn eq(&self, other: &EvalTestCase) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for EvalTestCase

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for EvalTestCase