Expand description
Asynchronous analysis: model-graded judges, plugins and re-analysis.
Re-analysis is the payoff of storing a trace reference instead of a verdict: a new analyzer version can rescore an existing case run without executing the agent again.
Structs§
- Analysis
Task - Claim
Analysis Request - Claim
Analysis Response - Judge
Evidence - Judge
Vote - One judge’s contribution. Kept per judge so a later question — “which judge was dragging the score?” — is answerable from stored data.
- Plugin
Evidence - Rerun
Analysis Request - Rescore stored case runs with a new analyzer set. Produces a new report revision; the executed evidence and trace reference are untouched.
- Rerun
Analysis Response - Submit
Analysis Request - Submit
Analysis Response