Skip to main content

Module testcase

Module testcase 

Source
Expand description

Test cases: the YAML a user writes to describe one test of a skill — the initial data to hand the skill, an optional simulated user for multi-turn runs, and the evals that decide pass/fail.

Structs§

SimulatedUser
The simulated-user block that turns a single-turn case into a multi-turn one. When present, after each assistant turn the runner asks the provider to play the user (guided by persona) until done_when holds or max_turns is hit.
TestCase
One test case.

Functions§

discover_cases
Discover test-case files: either a single .yaml/.yml file or every such file directly inside a directory (sorted for deterministic ordering).