Struct TelemetrySnapshot 

pub struct TelemetrySnapshot {
    pub prefill_tps: u32,
    pub decode_tps: u32,
    pub ttft_ms: u32,
    pub peak_bytes: u64,
    pub tokens_generated: u32,
    pub compressions: u32,
    pub safety_violations: u32,
}

A content-free sample of session performance.

Fields

prefill_tps: u32

decode_tps: u32

ttft_ms: u32

peak_bytes: u64

tokens_generated: u32

compressions: u32

safety_violations: u32

Trait Implementations

impl Clone for TelemetrySnapshot

fn clone(&self) -> TelemetrySnapshot

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for TelemetrySnapshot

impl Debug for TelemetrySnapshot

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for TelemetrySnapshot

fn default() -> TelemetrySnapshot

Returns the “default value” for a type.

impl Eq for TelemetrySnapshot

impl PartialEq for TelemetrySnapshot

fn eq(&self, other: &TelemetrySnapshot) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for TelemetrySnapshot