pub struct Config {
pub provider: ProviderConfig,
pub platforms: Vec<String>,
pub models: Vec<String>,
pub judge_model: String,
pub max_turns: u32,
}Expand description
The full configuration for a run.
Fields§
§provider: ProviderConfigThe provider that executes skills and evals.
platforms: Vec<String>Harness platforms a case runs on (e.g. claude-code, codex).
models: Vec<String>Models a case runs on (must be valid for the chosen harness, e.g.
sonnet/haiku for claude-code).
judge_model: StringModel used for natural-language evals and the simulated user. Falls back
to the first entry of models when empty.
max_turns: u32Default cap on assistant turns for multi-turn cases. A case may lower it.
Implementations§
Source§impl Config
impl Config
Sourcepub fn load(path: &Path) -> Result<Self>
pub fn load(path: &Path) -> Result<Self>
Load configuration from path. The standard config filename is
skilltest.yaml.
§Errors
Error::Io if the file cannot be read, Error::Yaml if it does not
parse, and Error::Invalid if it parses but is internally
inconsistent (see Config::validate).
Sourcepub fn load_or_default(path: &Path) -> Result<Self>
pub fn load_or_default(path: &Path) -> Result<Self>
Load path if it exists, otherwise return Config::default.
§Errors
Same as Config::load when the file is present but invalid.
Sourcepub fn apply_overrides(&mut self, overrides: Overrides) -> Result<()>
pub fn apply_overrides(&mut self, overrides: Overrides) -> Result<()>
Apply CLI overrides in place, then re-validate.
§Errors
Error::Invalid if the merged configuration is inconsistent.
Sourcepub fn effective_judge_model(&self) -> &str
pub fn effective_judge_model(&self) -> &str
The model used for evals and the simulated user: judge_model if set,
otherwise the first configured model.
Trait Implementations§
Source§impl<'de> Deserialize<'de> for Config
impl<'de> Deserialize<'de> for Config
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
impl Eq for Config
impl StructuralPartialEq for Config
Auto Trait Implementations§
impl Freeze for Config
impl RefUnwindSafe for Config
impl Send for Config
impl Sync for Config
impl Unpin for Config
impl UnsafeUnpin for Config
impl UnwindSafe for Config
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key and return true if they are equal.