pub async fn run_eval_specs(
specs: impl IntoIterator<Item = ResolvedEvalSpec>,
retention: WorkspaceRetention,
max_concurrency: NonZeroUsize,
) -> Result<Vec<EvalOutcome>, EvalFileError>Expand description
Run resolved eval specs. Agents and judge models are assembled before anything runs, so a broken case fails fast. Docker image builds are deduplicated and run concurrently before eval execution. Outcomes are returned in input order.