Skip to main content

Module batch

Module batch 

Source
Expand description

Batch validation of every <skill>/evals/evals.json under a skills dir.

Pure logic: it returns a ValidationReport instead of printing. The CLI handler renders the report (the / lines, the summary, the exit code), which keeps this batch logic unit-testable without capturing stdout.

Structs§

FileOutcome
The result of validating one <skill>/evals/evals.json.
ValidationReport
The outcome of a batch run, one entry per skill that had an evals.json.

Functions§

validate_all
Validate <skill>/evals/evals.json for every immediate child directory of skill_dir that has one. Directories without an evals.json are skipped; a parse or validation failure is recorded as a FileOutcome rather than aborting the batch. Skills are processed in sorted order for deterministic output.
validate_one
Validate exactly one skill’s evals/evals.json, reporting paths relative to that skill directory.