Skip to main content

Module evals

Module evals 

Source
Expand description

admin evals command group: judge runs over production AI traffic.

Exposes EvalsCommands — launch an auto-improve judge run, list and inspect runs, replay a run’s failures, and promote a sampled request into the golden case set. All inference goes through the process-local AiService built from the active profile.

Copyright (c) systemprompt.io — Business Source License 1.1. See https://systemprompt.io for licensing details.

Enums§

EvalsCommands

Functions§

execute