Struct Judge 

pub struct Judge {
    pub prompt: String,
    pub criteria: Vec<JudgeCriterionSpec>,
}

A built judge: the assembled prompt plus the normalized rubric it grades against. Run it with Judge::run against a model, or grade a parsed JudgeRubricResponse with Judge::summarize.

Fields

prompt: String

criteria: Vec<JudgeCriterionSpec>

Implementations

impl Judge

pub fn response_schema() -> Schema

pub async fn run( &self, llm: &dyn StreamingModelProvider, ) -> Result<JudgeSummary, JudgeError>

Grade llm against this judge’s rubric: stream the model’s response, parse it as a JudgeRubricResponse, and summarize it.

pub fn summarize( &self, response: JudgeRubricResponse, ) -> Result<JudgeSummary, JudgeError>

Trait Implementations

impl Clone for Judge

fn clone(&self) -> Judge

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Judge

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.