Skip to main content

run_eval_files

Function run_eval_files 

Source
pub async fn run_eval_files(
    options: EvalRunOptions,
) -> Result<EvalFilesReport, EvalFileError>
Expand description

Discover, validate, and run declarative eval files. Agents and judge models are assembled before anything runs, so a broken case fails fast. Docker image builds are deduplicated and run concurrently before eval execution. Outcomes are returned in discovery order.