Struct EvaluationRequest 

pub struct EvaluationRequest {
    pub evaluation_id: EvaluationId,
    pub scope: EvaluationScope,
    pub subjects: Vec<EvaluationSubject>,
    pub expected_outcome: ExpectedOutcome,
    pub comparison: ComparisonDesign,
    pub metric_deltas: Vec<EvaluationMetricDelta>,
    pub budget: EvaluationBudget,
    pub redacted_summary: String,
}

Request passed to an evaluator.

Fields

evaluation_id: EvaluationId

Stable evaluation id for lineage and test output.

scope: EvaluationScope

Durable scope being evaluated.

subjects: Vec<EvaluationSubject>

Subjects being evaluated or compared.

expected_outcome: ExpectedOutcome

Expected outcome supplied by a test, host, or reviewer.

comparison: ComparisonDesign

Comparison design for the evaluation.

metric_deltas: Vec<EvaluationMetricDelta>

Deterministic metric deltas supplied by local evaluators or tests.

budget: EvaluationBudget

Budget for evaluator work.

redacted_summary: String

Bounded request summary safe for logs and prompts.

Implementations

impl EvaluationRequest

pub fn new( evaluation_id: EvaluationId, scope: EvaluationScope, expected_outcome: ExpectedOutcome, ) -> Self

Creates an evaluation request with observed-only comparison defaults.

pub fn with_subject(self, subject: EvaluationSubject) -> Self

Returns this request with one subject appended.

pub fn with_comparison(self, comparison: ComparisonDesign) -> Self

Returns this request with its comparison design replaced.

pub fn with_metric_delta(self, metric_delta: EvaluationMetricDelta) -> Self

Returns this request with one deterministic metric delta appended.

pub fn with_metric_deltas( self, metric_deltas: impl IntoIterator<Item = EvaluationMetricDelta>, ) -> Self

Returns this request with deterministic metric deltas appended.

pub fn with_budget(self, budget: EvaluationBudget) -> Self

Returns this request with its budget replaced.

Trait Implementations

impl Clone for EvaluationRequest

fn clone(&self) -> EvaluationRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for EvaluationRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for EvaluationRequest

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for EvaluationRequest

fn eq(&self, other: &EvaluationRequest) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for EvaluationRequest

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Eq for EvaluationRequest

impl StructuralPartialEq for EvaluationRequest