Expand description
Batch validation of every <skill>/evals/evals.json under a skills dir.
Pure logic: it returns a ValidationReport instead of printing. The CLI
handler renders the report (the ✓/✗ lines, the summary, the exit code),
which keeps this batch logic unit-testable without capturing stdout.
Structs§
- File
Outcome - The result of validating one
<skill>/evals/evals.json. - Validation
Report - The outcome of a batch run, one entry per skill that had an
evals.json.
Functions§
- validate_
all - Validate
<skill>/evals/evals.jsonfor every immediate child directory ofskill_dirthat has one. Directories without anevals.jsonare skipped; a parse or validation failure is recorded as aFileOutcomerather than aborting the batch. Skills are processed in sorted order for deterministic output. - validate_
one - Validate exactly one skill’s
evals/evals.json, reporting paths relative to that skill directory.