Struct LlmJudgeSpec 

pub struct LlmJudgeSpec {

    pub judge: JudgeKind,
    pub judges: Vec<JudgeModel>,
    pub aggregation: JudgeAggregation,
    pub min_agreement: f64,
    pub prompt_digest: String,
    pub rubric: Option<Rubric>,
    pub pass_threshold: Option<f64>,
    pub samples: u32,
    pub temperature: f64,
    pub position_swap: bool,
    pub reference_ref: Option<String>,
    pub max_cost_micros: u64,
    pub inputs: JudgeInputs,
}

Model-graded evaluator. Everything that can move a verdict is pinned and digested, so judge drift can never be mistaken for subject regression.

Fields

judge: JudgeKind

judges: Vec<JudgeModel>

One entry is a single judge; more than one is a cross-model ensemble.

aggregation: JudgeAggregation

min_agreement: f64

Inter-judge agreement below this marks the result low_agreement, which drops it out of gating and into the human review queue.

prompt_digest: String

rubric: Option<Rubric>

pass_threshold: Option<f64>

samples: u32

Self-consistency samples per judge, aggregated within the judge first.

temperature: f64

position_swap: bool

Pairwise only: run both orderings to cancel position bias.

reference_ref: Option<String>

Reference only: pointer to the expected answer.

max_cost_micros: u64

Budget for the whole ensemble, not per judge.

inputs: JudgeInputs

Trait Implementations

impl Clone for LlmJudgeSpec

fn clone(&self) -> LlmJudgeSpec

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlmJudgeSpec

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for LlmJudgeSpec

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for LlmJudgeSpec

fn eq(&self, other: &LlmJudgeSpec) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for LlmJudgeSpec

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for LlmJudgeSpec