pub struct JudgingConfig {
pub votes_per_sample: u32,
pub judge_every_sample: bool,
}Expand description
How the judge is polled.
Fields§
§votes_per_sample: u32How many judge opinions are collected about one sample.
Votes reduce the judge’s own variance. They say nothing about the agent under test, so they never enter a deterministic pass rate. An odd number avoids ties; on a tie the lower score wins, because a judge harness that rounds up in its own favour is not a measurement.
judge_every_sample: boolJudge every sample, or only the first one of each item. Judging one sample per item is the usual choice: the judge is there to grade language, and language costs money to grade.
Trait Implementations§
Source§impl Clone for JudgingConfig
impl Clone for JudgingConfig
Source§impl Debug for JudgingConfig
impl Debug for JudgingConfig
Source§impl Default for JudgingConfig
impl Default for JudgingConfig
Source§impl<'de> Deserialize<'de> for JudgingConfigwhere
JudgingConfig: Default,
impl<'de> Deserialize<'de> for JudgingConfigwhere
JudgingConfig: Default,
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for JudgingConfig
Source§impl PartialEq for JudgingConfig
impl PartialEq for JudgingConfig
Source§impl Serialize for JudgingConfig
impl Serialize for JudgingConfig
impl StructuralPartialEq for JudgingConfig
Auto Trait Implementations§
impl Freeze for JudgingConfig
impl RefUnwindSafe for JudgingConfig
impl Send for JudgingConfig
impl Sync for JudgingConfig
impl Unpin for JudgingConfig
impl UnsafeUnpin for JudgingConfig
impl UnwindSafe for JudgingConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.