Struct Figures 

pub struct Figures {
    pub cold_start: ColdStart,
    pub tokens_per_second: Option<Measure>,
    pub ttft_ms: Option<Measure>,
    pub prompt_tokens_per_second: Option<Measure>,
    pub estimated_tokens: bool,
    pub source: TimingSource,
    pub runs: Vec<Sample>,
}

What a finished model’s runs came to.

Fields

cold_start: ColdStart

The cold run, or why there was none.

tokens_per_second: Option<Measure>

Tokens a second over the warm runs.

ttft_ms: Option<Measure>

Time to first token over the warm runs.

prompt_tokens_per_second: Option<Measure>

Prompt tokens a second, where the backend timed the prompt.

estimated_tokens: bool

Whether any warm run’s token count was estimated.

source: TimingSource

Where the decode timing came from; wall clock if any run fell back.

runs: Vec<Sample>

The warm runs themselves, for the detail and the JSON.

Implementations

impl Figures

pub fn summarize(cold: ColdStart, runs: Vec<Sample>) -> Self

Summarize the warm runs of one model, with cold saying what the run before them measured, or why there was not one.

pub fn rate(&self) -> Option<f64>

The rate the row is ranked and drawn by.

Trait Implementations

impl Clone for Figures

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Figures

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Figures

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Figures