Struct AutomatedEvaluationConfig 

#[non_exhaustive]
pub struct AutomatedEvaluationConfig {
    pub dataset_metric_configs: Vec<EvaluationDatasetMetricConfig>,
    pub evaluator_model_config: Option<EvaluatorModelConfig>,
    pub custom_metric_config: Option<AutomatedEvaluationCustomMetricConfig>,
}

The configuration details of an automated evaluation job. The EvaluationDatasetMetricConfig object is used to specify the prompt datasets, task type, and metric names.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

dataset_metric_configs: Vec<EvaluationDatasetMetricConfig>

Configuration details of the prompt datasets and metrics you want to use for your evaluation job.

evaluator_model_config: Option<EvaluatorModelConfig>

Contains the evaluator model configuration details. EvaluatorModelConfig is required for evaluation jobs that use a knowledge base or in model evaluation job that use a model as judge. This model computes all evaluation related metrics.

custom_metric_config: Option<AutomatedEvaluationCustomMetricConfig>

Defines the configuration of custom metrics to be used in an evaluation job.

Implementations

impl AutomatedEvaluationConfig

pub fn dataset_metric_configs(&self) -> &[EvaluationDatasetMetricConfig]

Configuration details of the prompt datasets and metrics you want to use for your evaluation job.

pub fn evaluator_model_config(&self) -> Option<&EvaluatorModelConfig>

Contains the evaluator model configuration details. EvaluatorModelConfig is required for evaluation jobs that use a knowledge base or in model evaluation job that use a model as judge. This model computes all evaluation related metrics.

pub fn custom_metric_config( &self, ) -> Option<&AutomatedEvaluationCustomMetricConfig>

Defines the configuration of custom metrics to be used in an evaluation job.

impl AutomatedEvaluationConfig

pub fn builder() -> AutomatedEvaluationConfigBuilder

Creates a new builder-style object to manufacture AutomatedEvaluationConfig.

Trait Implementations

impl Clone for AutomatedEvaluationConfig

fn clone(&self) -> AutomatedEvaluationConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for AutomatedEvaluationConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for AutomatedEvaluationConfig

fn eq(&self, other: &AutomatedEvaluationConfig) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for AutomatedEvaluationConfig