Struct Config 

pub struct Config {
    pub provider: ProviderConfig,
    pub platforms: Vec<String>,
    pub models: Vec<String>,
    pub judge_model: String,
    pub max_turns: u32,
    pub judge: Option<JudgeConfig>,
    pub mocks: Vec<MockDecl>,
    pub spy: bool,
}

The full configuration for a run.

Fields

provider: ProviderConfig

The provider that executes skills and evals.

platforms: Vec<String>

Harness platforms a case runs on (e.g. claude-code, codex).

models: Vec<String>

Models a case runs on (must be valid for the chosen harness, e.g. sonnet/haiku for claude-code).

judge_model: String

Model used for natural-language evals and the simulated user. Falls back to the first entry of models when empty.

max_turns: u32

Default cap on assistant turns for multi-turn cases. A case may lower it.

judge: Option<JudgeConfig>

Optional judge backend that overrides how evals and the simulated user are scored, independent of the skill-running provider. When None, the provider judges (e.g. the oneharness judge_harness).

mocks: Vec<MockDecl>

Shared mock/spy declarations, prepended to every case’s own mocks (first match wins, so these shadow the case’s). Populated by the CLI’s --mocks <file> — how the SDKs deliver code-level mocks — or written here directly for suite-wide rules.

spy: bool

Force the mock/spy observation channel on for every run, even for cases that declare no mocks (the CLI’s --spy; how SDK spies get records).

Implementations

impl Config

pub fn load(path: &Path) -> Result<Self>

Load configuration from path. The standard config filename is skilltest.yaml.

Errors

Error::Io if the file cannot be read, Error::Yaml if it does not parse, and Error::Invalid if it parses but is internally inconsistent (see Config::validate).

pub fn load_or_default(path: &Path) -> Result<Self>

Load path if it exists, otherwise return Config::default.

Errors

Same as Config::load when the file is present but invalid.

pub fn apply_overrides(&mut self, overrides: Overrides) -> Result<()>

Apply CLI overrides in place, then re-validate.

Errors

Error::Invalid if the merged configuration is inconsistent.

pub fn effective_judge_model(&self) -> &str

The model used for evals and the simulated user: judge_model if set, otherwise the first configured model.

pub fn validate(&self) -> Result<()>

Check internal consistency.

Errors

Error::Invalid when the provider is misconfigured or no platform/model is set.

Trait Implementations

impl Clone for Config

fn clone(&self) -> Config

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Config

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Config

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for Config

where Config: Default,

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for Config

fn eq(&self, other: &Config) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for Config

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for Config