Struct EvalRunnerOptions 

pub struct EvalRunnerOptions {

    pub agent: Option<PathBuf>,
    pub scenarios: Option<PathBuf>,
    pub output: PathBuf,
    pub ids: Vec<String>,
    pub tags: Vec<String>,
    pub tag_mode_all: bool,
    pub languages: Vec<String>,
    pub retries: Option<u32>,
    pub timeout_ms: Option<u64>,
    pub parallel: Option<usize>,
    pub fail_fast: bool,
    pub observability: bool,
    pub llm_mode: Option<LlmFixtureMode>,
    pub cassette: Option<PathBuf>,
}

Runtime options supplied by CLI or Rust callers.

Fields

agent: Option<PathBuf>

Agent YAML path used for this run.

scenarios: Option<PathBuf>

Scenario test cases in this suite.

output: PathBuf

Directory where output artifacts are written.

ids: Vec<String>

Scenario IDs selected for execution.

tags: Vec<String>

Tags used by filters and grouped metrics.

tag_mode_all: bool

Whether all selected tags must match.

languages: Vec<String>

Language labels selected for execution.

retries: Option<u32>

Optional retry count or suite retry count.

timeout_ms: Option<u64>

Optional timeout override for this turn.

parallel: Option<usize>

Optional scenario concurrency override.

fail_fast: bool

Stop after the first failed or errored scenario.

observability: bool

Observability assertion, setting, or report value.

llm_mode: Option<LlmFixtureMode>

Optional LLM fixture mode override.

cassette: Option<PathBuf>

Optional cassette JSONL file for replay or record mode.

Trait Implementations

impl Clone for EvalRunnerOptions

fn clone(&self) -> EvalRunnerOptions

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for EvalRunnerOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for EvalRunnerOptions

fn default() -> EvalRunnerOptions

Returns the “default value” for a type.