Struct RemotePrefill 

pub struct RemotePrefill {
    pub rid: String,
    pub bootstrap_token: i32,
    pub cached_tokens: i64,
    pub bootstrap_logprob: Option<f64>,
    pub spec_candidate_ids: Option<Vec<i32>>,
    pub request_pool_index: i32,
}

A D-role request whose KV landed.

Fields

rid: String

The request.

bootstrap_token: i32

The prefill node’s first token: a landing without one is a failed transfer, as the request’s first decode feeds on it.

cached_tokens: i64

Prompt tokens the prefill node served from its cache.

bootstrap_logprob: Option<f64>

The first token’s logprob, if the prefill node sent one.

spec_candidate_ids: Option<Vec<i32>>

The prefill node’s drafter candidates, if any.

request_pool_index: i32

The request’s slot here.

Trait Implementations

impl Clone for RemotePrefill

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RemotePrefill

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for RemotePrefill

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for RemotePrefill