pub struct GenerationStats {
pub tokens_generated: usize,
pub avg_token_time_ms: f64,
pub avg_sparsity: f64,
pub total_time_ms: f64,
}Expand description
Generation statistics
Fields§
§tokens_generated: usizeTotal tokens generated
avg_token_time_ms: f64Average inference time per token (ms)
avg_sparsity: f64Average sparsity ratio
total_time_ms: f64Total inference time (ms)
Trait Implementations§
Source§impl Clone for GenerationStats
impl Clone for GenerationStats
Source§fn clone(&self) -> GenerationStats
fn clone(&self) -> GenerationStats
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for GenerationStats
impl Debug for GenerationStats
Source§impl Default for GenerationStats
impl Default for GenerationStats
Source§fn default() -> GenerationStats
fn default() -> GenerationStats
Returns the “default value” for a type. Read more
Auto Trait Implementations§
impl Freeze for GenerationStats
impl RefUnwindSafe for GenerationStats
impl Send for GenerationStats
impl Sync for GenerationStats
impl Unpin for GenerationStats
impl UnwindSafe for GenerationStats
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more