pub struct SavedResponses {
pub schema_version: u32,
pub dataset_id: String,
pub provider: String,
pub input_price_per_million_usd: Option<f64>,
pub output_price_per_million_usd: Option<f64>,
pub results: Vec<SavedResult>,
}Expand description
Versioned saved provider results for fully offline evaluation.
Fields§
§schema_version: u32Version of the response schema.
dataset_id: StringDataset identifier that these results belong to.
provider: StringProvider identifier, independent of the model version.
input_price_per_million_usd: Option<f64>Input token price; omitted when unknown.
output_price_per_million_usd: Option<f64>Output token price; omitted when unknown.
results: Vec<SavedResult>One outcome per observed case. Missing cases are allowed and reported.
Implementations§
Source§impl SavedResponses
impl SavedResponses
Sourcepub fn validate_against(
&self,
fixture: &FixtureSuite,
) -> Result<(), EvaluationError>
pub fn validate_against( &self, fixture: &FixtureSuite, ) -> Result<(), EvaluationError>
Validate saved outcomes against a fixture without requiring completeness.
§Errors
Returns EvaluationError::Invalid for unknown, repeated, or malformed results.
Trait Implementations§
Source§impl Clone for SavedResponses
impl Clone for SavedResponses
Source§impl Debug for SavedResponses
impl Debug for SavedResponses
Source§impl<'de> Deserialize<'de> for SavedResponses
impl<'de> Deserialize<'de> for SavedResponses
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Forget for SavedResponses
impl Freeze for SavedResponses
impl Move for SavedResponses
impl RefUnwindSafe for SavedResponses
impl Send for SavedResponses
impl Sync for SavedResponses
impl Unpin for SavedResponses
impl UnsafeUnpin for SavedResponses
impl UnwindSafe for SavedResponses
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more