Expand description
Evaluation services: sampling, judging, replay, and the auto-improve loop.
All inference goes through the supplied
DynAiProvider with a job actor
so the trace sampler never selects the framework’s own traffic.
Copyright (c) systemprompt.io — Business Source License 1.1. See https://systemprompt.io for licensing details.
Structs§
- Auto
Improve Loop - Sample → judge → repair-hint → replay → re-judge, one pass.
- Evaluation
Service - Judge
Service - Judge
Target - What the judge grades: the prompt transcript and the response under test.
- Loop
Limits - Loop
Report - Replay
Service - RunRequest
- Sampler
Service - Scored
Verdict