Struct CaptureRequestShape 

pub struct CaptureRequestShape {
    pub batch: u64,
    pub prompt_tokens: u64,
    pub max_predictions: u64,
}

Request geometry used for admission. This initial protocol is ordinary committed text generation; media, speculative and rank-partitioned runs need separate support.

Fields

batch: u64

Number of sequences in the request.

prompt_tokens: u64

Number of prefill positions per sequence.

max_predictions: u64

Maximum number of generated predictions, including the prefill prediction.

Implementations

impl CaptureRequestShape

pub fn validate_actual( self, point: &ObservationPoint, phase: CapturePhase, prediction: u64, shape: &[u64], ) -> Result<(), CaptureError>

Checks every known or request-resolved axis, even when another axis is unknown.

pub fn resolve( self, point: &ObservationPoint, phase: CapturePhase, prediction: u64, ) -> Result<Option<Vec<u64>>, CaptureError>

Resolves symbolic axes against the request; an unknown extent returns None.

Trait Implementations

impl Clone for CaptureRequestShape

fn clone(&self) -> CaptureRequestShape

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for CaptureRequestShape

impl Debug for CaptureRequestShape

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for CaptureRequestShape

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for CaptureRequestShape

impl PartialEq for CaptureRequestShape

fn eq(&self, other: &CaptureRequestShape) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for CaptureRequestShape

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for CaptureRequestShape