Expand description
Run results and the JSON report. The serialized shape here is the stable
contract the language SDKs parse. These types are the source of truth:
their JSON Schemas (via skilltest schema, goldens in schemas/) are what
the SDK contract tests compare their Pydantic/Zod models against.
Structs§
- CaseRun
- The result of running one test case on one (platform, model) pair.
- Report
- The top-level report for a
skilltest runinvocation. - Report
Error - A structured error, emitted as the
--format json/json-streamoutput when askilltest runcannot produce aReport. - Summary
- Aggregate pass/fail counts for a report.
- Validation
Finding - One problem found while validating a skill, as serialized in the
skilltest validate --format jsonoutput. - Validation
Report - The top-level report for a
skilltest validateinvocation.
Enums§
- Error
Code - Which class of failure a
ReportErrordescribes. Mirrors the process exit code so a JSON consumer gets the same coarse classification as a shell script branching on$?.