Struct ExecutorPrefillAdmission 

pub struct ExecutorPrefillAdmission<'a> {
    pub request_id: &'a RequestId,
    pub input_tokens: &'a [TokenId],
    pub maximum_sequence_tokens: usize,
    pub product_prompt_tokens: usize,
    pub replayed_output_tokens: usize,
    pub request_origin: ExecutorRequestOrigin,
}

Borrowed, already-tokenized input used to probe plan-runtime prefill admission before the request can enter a device submission batch.

This carries semantic token identity rather than an aggregate token count: vNext derives the exact resource work shape and its fingerprint from this boundary. The request remains owned by the scheduler while the executor retains any admitted authority internally until ModelExecutor::prefill consumes it or cancellation releases it.

Fields

request_id: &'a RequestId

input_tokens: &'a [TokenId]

maximum_sequence_tokens: usize

product_prompt_tokens: usize

Prompt tokens reported in the final product usage.

replayed_output_tokens: usize

Already-committed output tokens replayed as part of a recompute input.

request_origin: ExecutorRequestOrigin

Implementations

impl<'a> ExecutorPrefillAdmission<'a>

pub const fn for_startup( request_id: &'a RequestId, input_tokens: &'a [TokenId], maximum_sequence_tokens: usize, ) -> Self

pub const fn for_diagnostic( request_id: &'a RequestId, input_tokens: &'a [TokenId], maximum_sequence_tokens: usize, ) -> Self

pub fn for_product_request( request_id: &'a RequestId, input_tokens: &'a [TokenId], maximum_sequence_tokens: usize, product_prompt_tokens: usize, replayed_output_tokens: usize, ) -> Result<Self>

Construct admission for a product request whose execution context may include output tokens replayed after preemption.

pub fn validate(&self) -> Result<()>

Trait Implementations

impl<'a> Clone for ExecutorPrefillAdmission<'a>

fn clone(&self) -> ExecutorPrefillAdmission<'a>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Copy for ExecutorPrefillAdmission<'a>

impl<'a> Debug for ExecutorPrefillAdmission<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.