pub struct BenchmarkSummary {Show 16 fields
pub config_name: String,
pub total_queries: usize,
pub avg_latency_ms: f64,
pub avg_retrieval_ms: f64,
pub avg_reranking_ms: f64,
pub avg_generation_ms: f64,
pub total_input_tokens: usize,
pub total_output_tokens: usize,
pub total_cost_usd: f64,
pub avg_tokens_per_query: f64,
pub avg_exact_match: f64,
pub avg_f1_score: f64,
pub avg_bleu_score: f64,
pub avg_rouge_l: f64,
pub features: Vec<String>,
pub query_results: Vec<QueryBenchmark>,
}Expand description
Aggregate benchmark results across multiple queries
Fields§
§config_name: StringConfiguration used
total_queries: usizeNumber of queries evaluated
avg_latency_ms: f64Average metrics
avg_retrieval_ms: f64Average retrieval latency in milliseconds
avg_reranking_ms: f64Average reranking latency in milliseconds
avg_generation_ms: f64Average generation latency in milliseconds
total_input_tokens: usizeToken statistics Total input tokens across all queries
total_output_tokens: usizeTotal output tokens across all queries
total_cost_usd: f64Total cost in USD
avg_tokens_per_query: f64Average tokens per query
avg_exact_match: f64Quality statistics Average exact match score
avg_f1_score: f64Average F1 score
avg_bleu_score: f64Average BLEU score
avg_rouge_l: f64Average ROUGE-L score
features: Vec<String>Features enabled
query_results: Vec<QueryBenchmark>Per-query results
Trait Implementations§
Source§impl Clone for BenchmarkSummary
impl Clone for BenchmarkSummary
Source§fn clone(&self) -> BenchmarkSummary
fn clone(&self) -> BenchmarkSummary
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for BenchmarkSummary
impl Debug for BenchmarkSummary
Source§impl<'de> Deserialize<'de> for BenchmarkSummary
impl<'de> Deserialize<'de> for BenchmarkSummary
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for BenchmarkSummary
impl RefUnwindSafe for BenchmarkSummary
impl Send for BenchmarkSummary
impl Sync for BenchmarkSummary
impl Unpin for BenchmarkSummary
impl UnsafeUnpin for BenchmarkSummary
impl UnwindSafe for BenchmarkSummary
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more