Struct EvalSettings 

pub struct EvalSettings {
    pub temperature: Option<f32>,
    pub seed: Option<u64>,
    pub timeout_per_turn_ms: u64,
    pub timeout_per_scenario_ms: Option<u64>,
    pub retries: u32,
    pub retry_delay_ms: u64,
    pub isolation: IsolationMode,
    pub parallel: bool,
    pub max_concurrent: usize,
    pub fail_fast: bool,
    pub redact_outputs: bool,
}

Execution policy for an evaluation suite.

Fields

temperature: Option<f32>

Optional temperature override for eval LLMs.

seed: Option<u64>

Optional provider seed stored in LLM extra config.

timeout_per_turn_ms: u64

Default timeout for one turn in milliseconds.

timeout_per_scenario_ms: Option<u64>

Timeout for one scenario attempt in milliseconds.

retries: u32

Optional retry count or suite retry count.

retry_delay_ms: u64

Delay between retry attempts in milliseconds.

isolation: IsolationMode

Runtime isolation mode for scenarios or turns.

parallel: bool

Optional scenario concurrency override.

max_concurrent: usize

Maximum concurrently running scenarios.

fail_fast: bool

Stop after the first failed or errored scenario.

redact_outputs: bool

Whether output artifacts should redact sensitive strings.

Trait Implementations

impl Clone for EvalSettings

fn clone(&self) -> EvalSettings

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for EvalSettings

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for EvalSettings

fn default() -> EvalSettings

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for EvalSettings

fn deserialize<__D>( __deserializer: __D, ) -> Result<EvalSettings, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.