Module transcript_check 

Transcript-check grading.

A transcript_check assertion of kind tool_invocation_matches passes when its pattern regex matches the "<name> <json-args>" rendering of any tool invocation in the run.

Functions

grade_transcript_check

Grade a transcript_check assertion against a run’s tool invocations, covering the empty-invocations, unsupported-kind, missing-pattern, invalid-regex, match, and no-match branches.