Struct StatusMessage 

pub struct StatusMessage {
    pub room: u64,
    pub status: TransferPoll,
    pub prefill_rank: i64,
    pub bootstrap_token: i64,
    pub spec_candidate_ids: Option<Vec<i32>>,
    pub cached_tokens: i64,
    pub bootstrap_logprob: Option<f64>,
}

A Prefill rank’s report on one room.

Fields

room: u64

The room.

status: TransferPoll

Its state on the sender.

prefill_rank: i64

The sender in Decode’s completion-tracking rank space.

bootstrap_token: i64

The first output token, -1 if none.

spec_candidate_ids: Option<Vec<i32>>

The drafter’s candidates for the first decode, if any.

cached_tokens: i64

Prompt tokens the sender served from its cache.

bootstrap_logprob: Option<f64>

The first token’s logprob, if the request returns logprobs.

Implementations

impl StatusMessage

pub fn bare(room: u64, status: TransferPoll, prefill_rank: i64) -> Self

A bare status: no first token and no usage.

pub fn to_frames(&self) -> Vec<Bytes>

The message’s frames.

pub fn from_frames(frames: &[Bytes]) -> Result<Self, WireError>

Parse a status message; the last three frames are optional, as older senders omit them.

Trait Implementations

impl Clone for StatusMessage

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for StatusMessage

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for StatusMessage

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for StatusMessage