Skip to main content

grade_transcript_check

eval_magic::pipeline::grade::transcript_check

Function grade_transcript_check 

Source 
pub fn grade_transcript_check(
    assertion: &AssertionTranscriptCheck,
    invocations: &[ToolInvocation],
) -> AssertionResult
Expand description

Grade a transcript_check assertion against a run’s tool invocations, covering the empty-invocations, unsupported-kind, missing-pattern, invalid-regex, match, and no-match branches.