pub struct Scorer {
pub id: Option<String>,
pub name: Option<String>,
pub pass_if: Option<f64>,
pub kind: Kind,
pub path: String,
}Expand description
Scorer : A scorer is a column of the results table, and it is always a runnable: an ai_agent resource sent the run to grade, or a script handed the run as an argument. id is assigned when the scorer is added to a dataset and never reused: it is what makes a column the same column across experiments when the scorer is renamed, and a delta is only ever computed between two scores carrying the same id. A scorer sent without an id is given one.
Fields§
§id: Option<String>§name: Option<String>Column header. Defaults to the last segment of the path.
pass_if: Option<f64>A score at or above this counts as a pass, and the column reports a pass rate beside its mean. Applied when results are read rather than when they are produced, so moving the line re-reads every score already recorded instead of invalidating them.
kind: Kind§path: StringThe script, or the ai_agent resource used as a judge.
Implementations§
Source§impl Scorer
impl Scorer
Sourcepub fn new(kind: Kind, path: String) -> Scorer
pub fn new(kind: Kind, path: String) -> Scorer
A scorer is a column of the results table, and it is always a runnable: an ai_agent resource sent the run to grade, or a script handed the run as an argument. id is assigned when the scorer is added to a dataset and never reused: it is what makes a column the same column across experiments when the scorer is renamed, and a delta is only ever computed between two scores carrying the same id. A scorer sent without an id is given one.