Expand description
Conformance & reproducibility scorecard (conformance-v1, EPIC 12.17).
A self-check any user or CI can run to prove this instance honors its own contracts and that its extension surface behaves. It exercises three areas:
- contracts — every machine-verified contract version is present.
- reproducibility — the public discovery documents (
/v1/capabilities,/v1/openapi.json) are deterministic (same bytes across two builds). - extensions — every registered compressor / chunker / read-mode in the
extension_registrysatisfies the stable invariants the engine relies on (determinism, budget honoring, coverage).
The output is a Scorecard: a flat list of Checks plus a pass count.
It is data, not prose, so it can be rendered (CLI), shared (JSON), or gated
on (all_passed() in tests/conformance_suite.rs).
Structs§
- Check
- One conformance check result.
- Conformance
Failure - Conformance
Result - Result of checking a capability manifest or invocation against contract rules.
- Scorecard
- The full result of a conformance run.
Functions§
- check_
invocation_ conformance - Validate a CapabilityResult against the manifest’s declared constraints.
- check_
manifest_ conformance - Validate a CapabilityManifestV1 against OCLA contract rules.
- register_
read_ mode_ renderer - Register the
ctx_readrenderer the accuracy checks run against. The read tools live above the engine; the CLI registers them at start-up (tools::ctx_read::register_conformance_renderer). The first registration wins. - run
- Run the full conformance suite against this instance.
Type Aliases§
- Read
Mode Renderer - The
ctx_readmode renderer the accuracy checks measure: the signature oftools::ctx_read::process_mode(content, mode, file ref, short name, extension, original tokens, CRP mode, file path, task) returning the rendered view and its pre-footer body token count.