Struct AggregateRateSnapshot 

pub struct AggregateRateSnapshot {
    pub completed_requests: u64,
    pub mean_tokens_per_second: f64,
    pub tbt_p50_seconds: f64,
    pub tbt_p95_seconds: f64,
    pub mean_queue_wait_seconds: f64,
}

Workload-level rollup of recent request rate snapshots.

Fields

completed_requests: u64

Number of completed requests in the window.

mean_tokens_per_second: f64

Mean tokens-per-second across the window.

tbt_p50_seconds: f64

p50 inter-token latency across the window.

tbt_p95_seconds: f64

p95 inter-token latency across the window.

mean_queue_wait_seconds: f64

Mean queue wait time across the window.

Trait Implementations

impl Clone for AggregateRateSnapshot

fn clone(&self) -> AggregateRateSnapshot

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for AggregateRateSnapshot

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for AggregateRateSnapshot

fn eq(&self, other: &AggregateRateSnapshot) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for AggregateRateSnapshot

impl StructuralPartialEq for AggregateRateSnapshot