Struct TurnTtftState 

pub struct TurnTtftState { /* private fields */ }

Client-observed time-to-first-token state for the active and last turn.

Implementations

impl TurnTtftState

pub fn start_turn(&mut self)

Start timing a newly submitted local user turn.

pub fn stop_on_semantic_output(&mut self)

Stop timing on the first semantic provider output.

pub fn clear_pending(&mut self)

Clear an unfinished pending measurement without replacing the last one.

pub fn is_pending(&self) -> bool

Whether the current turn is still waiting for semantic output.

pub fn last_completed(&self) -> Option<Duration>

Last successfully measured TTFT.

Trait Implementations

impl Clone for TurnTtftState

fn clone(&self) -> TurnTtftState

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TurnTtftState

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for TurnTtftState

fn default() -> TurnTtftState

Returns the “default value” for a type.