pub struct EvaluatorConfig {
pub schema: String,
pub adapter: ConfigAdapter,
pub label_interpretation: String,
pub agreement: Agreement,
pub probability_step: Option<String>,
pub reliability_bins: Vec<Decimal>,
pub subgroups: Vec<String>,
pub latency_quantiles: Vec<Decimal>,
pub cost_units_comparable: bool,
pub metrics: Vec<MetricFormula>,
pub gates: Vec<Gate>,
pub temperature_grid: Vec<Decimal>,
}Fields§
§schema: String§adapter: ConfigAdapter§label_interpretation: StringWhat a label means, in words.
agreement: Agreement§probability_step: Option<String>The step whose probability vector log loss, Brier and reliability score; none when the task has no probability to score.
reliability_bins: Vec<Decimal>Reliability bin boundaries: strictly increasing from 0 to 1.
subgroups: Vec<String>Declared subgroups, reported besides the whole cohort.
latency_quantiles: Vec<Decimal>Latency quantiles in (0, 1], strictly increasing (nearest rank).
cost_units_comparable: boolWhether every backend’s cost units may be added together.
metrics: Vec<MetricFormula>Every metric this configuration reports, with its formula in words.
gates: Vec<Gate>§temperature_grid: Vec<Decimal>Candidate temperatures for fitting: strictly increasing, in (0, 1000], at most 4096; empty when nothing is fitted.
Implementations§
Source§impl EvaluatorConfig
impl EvaluatorConfig
Sourcepub fn bound_rules(&self) -> Option<&ContentDigest>
pub fn bound_rules(&self) -> Option<&ContentDigest>
The rules digest a gate may compare: bound in version 2, otherwise none (version 1 rules are unbound, spec 014 3.2.3).
pub fn check(&self) -> Result<(), ConfigError>
Trait Implementations§
Source§impl Clone for EvaluatorConfig
impl Clone for EvaluatorConfig
Source§impl Debug for EvaluatorConfig
impl Debug for EvaluatorConfig
Source§impl<'de> Deserialize<'de> for EvaluatorConfig
impl<'de> Deserialize<'de> for EvaluatorConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Source§impl Document for EvaluatorConfig
Either version parses; SCHEMA names version 1 only because the trait
holds one constant. The identity is tagged with the document’s own
schema, so a version 1 identity is what it always was.
impl Document for EvaluatorConfig
Either version parses; SCHEMA names version 1 only because the trait
holds one constant. The identity is tagged with the document’s own
schema, so a version 1 identity is what it always was.
Source§const SCHEMA: &'static str = EVALUATOR_CONFIG
const SCHEMA: &'static str = EVALUATOR_CONFIG
Source§const LIMITS: ParseLimits = REPLAY_V1
const LIMITS: ParseLimits = REPLAY_V1
Source§fn parse(bytes: &[u8]) -> Result<Self, DocumentError>
fn parse(bytes: &[u8]) -> Result<Self, DocumentError>
Source§fn record_digest(&self) -> Result<ContentDigest, CanonicalError>
fn record_digest(&self) -> Result<ContentDigest, CanonicalError>
sha256(SCHEMA || 0x00 || record canonical bytes) (spec 004, 3.1.6).
Equal to the identity of an identified document.Source§fn record_canonical(&self) -> Result<Vec<u8>, CanonicalError>where
Self: PartialEq,
fn record_canonical(&self) -> Result<Vec<u8>, CanonicalError>where
Self: PartialEq,
impl Eq for EvaluatorConfig
Source§impl Identified for EvaluatorConfig
impl Identified for EvaluatorConfig
type Id = EvaluatorConfigId
Source§fn id(&self) -> Result<EvaluatorConfigId, CanonicalError>
fn id(&self) -> Result<EvaluatorConfigId, CanonicalError>
sha256(SCHEMA || 0x00 || canonical bytes) (spec 002, 3.3.2).