Expand description
Retries: the verifier’s failure digest for the next attempt, and the fingerprint that stops retries which cannot help.
Everything here comes from verifier output — never from the model’s transcript or its own account of what went wrong.
Structs§
- Digest
- What the next attempt is told about the previous one.
- Failed
Check - One check that did not pass.
Functions§
- digest
- The digest of a failed attempt.
- fingerprint
- The failure’s identity: failing checks by name, each with its first error line, numbers normalised. Equal fingerprints mean the same failure.
- first_
cause - What a failed check says first, for a person: its failing tests by
name, else the first error line of its output (rules of
=or_skipped), cut at 160 characters.None: it said nothing. - held_
out_ reason - The retry reason for failed held-out tests: the scenario IDs and the spec’s own words — which the implementer has already seen — and nothing from the held-out run itself (no path, test name, literal or output).
- infrastructure
- Why a failed attempt must not be retried, if it must not: a check that could not run at all is an infrastructure problem, not the model’s.