swink-agent-eval 0.9.0

Evaluation framework for swink-agent: trajectory tracing, golden path verification, and cost governance
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20

//! Experiment generation primitives.
//!
//! This module implements Phase 7 (US5) of spec 043-evals-adv-features:
//!
//! * [`TopicPlanner`] produces an even topic-distribution across a request.
//! * [`ExperimentGenerator`] turns a [`GenerationRequest`] into a validated
//!   [`EvalSet`](crate::types::EvalSet), retrying on malformed judge output
//!   up to a bounded cap and omitting unrecoverable slots.
//!
//! Gated by the `generation` feature.

#![forbid(unsafe_code)]

pub mod experiment;
pub mod topic;

pub use experiment::{
    DEFAULT_RETRY_CAP, ExperimentGenerator, GenerationError, GenerationRequest, ToolDef,
};
pub use topic::{TopicPlanner, TopicSlot};