Struct LlmJudgeScorer 

pub struct LlmJudgeScorer {
    pub model: Arc<dyn JudgeModel>,
    pub prompt_template: String,
}

Single-criterion graded scorer — “did the actual output answer the expected question correctly?”. The judge replies pass / fail followed by a short justification.

Fields

model: Arc<dyn JudgeModel>

prompt_template: String

Implementations

impl LlmJudgeScorer

pub fn new(model: Arc<dyn JudgeModel>) -> Self

Trait Implementations

impl AsyncScorer for LlmJudgeScorer

fn score<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, expected: &'life1 Value, actual: &'life2 Value, ) -> Pin<Box<dyn Future<Output = ScorerOutcome> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,