pub struct DeterministicEvalRunner {
pub seed: u64,
}Expand description
Deterministic execution harness for EvalSuite runs.
Fields§
§seed: u64Implementations§
Source§impl DeterministicEvalRunner
impl DeterministicEvalRunner
pub fn new(seed: u64) -> Self
Sourcepub fn run_with_outputs(
&self,
suite: &EvalSuite,
actual_outputs: &HashMap<Uuid, Value>,
) -> Result<EvalRunReport>
pub fn run_with_outputs( &self, suite: &EvalSuite, actual_outputs: &HashMap<Uuid, Value>, ) -> Result<EvalRunReport>
Execute suite scoring deterministically using provided case outputs.
actual_outputs maps test case IDs to the concrete run output for that case.
Returns Err if suite.suite_digest is empty (call finalize() first).
Trait Implementations§
Source§impl Clone for DeterministicEvalRunner
impl Clone for DeterministicEvalRunner
Source§fn clone(&self) -> DeterministicEvalRunner
fn clone(&self) -> DeterministicEvalRunner
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for DeterministicEvalRunner
impl Debug for DeterministicEvalRunner
impl Copy for DeterministicEvalRunner
Auto Trait Implementations§
impl Freeze for DeterministicEvalRunner
impl RefUnwindSafe for DeterministicEvalRunner
impl Send for DeterministicEvalRunner
impl Sync for DeterministicEvalRunner
impl Unpin for DeterministicEvalRunner
impl UnsafeUnpin for DeterministicEvalRunner
impl UnwindSafe for DeterministicEvalRunner
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more