Struct Output 

pub struct Output {
    pub request_id: Uuid,
    pub token_id: Option<u32>,
    pub completed: bool,
    pub rejected: bool,
    pub cached_tokens: Option<usize>,
}

One client-visible output.

Fields

request_id: Uuid

Request producing the output.

token_id: Option<u32>

Generated token, or None for a terminal-without-token signal.

completed: bool

Whether request ownership ended with this output.

rejected: bool

Whether admission rejected the request as physically impossible.

cached_tokens: Option<usize>

Prompt tokens served from KV cache at first admission, reported once on the request’s first output.

Trait Implementations

impl Clone for Output

fn clone(&self) -> Output

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Output

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Output

fn eq(&self, other: &Output) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Output