Enum ReusableExecutionProgramShape 

pub enum ReusableExecutionProgramShape {
    UniformDecode {
        request_capacity: u32,
        token_capacity: u64,
        query_tokens_per_sequence: u32,
    },
    Prefill {
        tokens_processed: u64,
        token_capacity: u64,
        total_prompt_tokens: u64,
    },
}

Exact logical startup capture case for a reusable device-program catalog.

Workspace buckets are capacity envelopes and may cover smaller work. These shapes are different: each row requests one exact logical startup case. The resulting physical program identity additionally includes pages, provider topology, lane layout, and runtime fingerprints. Consequently one logical width does not claim replay coverage for every context/topology variant. v0.8.0 deliberately does not imply padded replay.

Variants

UniformDecode

Fields

request_capacity: u32

token_capacity: u64

query_tokens_per_sequence: u32

Prefill

Fields

tokens_processed: u64

token_capacity: u64

total_prompt_tokens: u64

Implementations

impl ReusableExecutionProgramShape

pub fn uniform_decode( request_capacity: u32, query_tokens_per_sequence: u32, ) -> Result<Self, VNextError>

pub fn prefill( tokens_processed: u64, token_capacity: u64, total_prompt_tokens: u64, ) -> Result<Self, VNextError>

pub const fn request_capacity(self) -> u32

pub const fn token_capacity(self) -> u64

Trait Implementations

impl Clone for ReusableExecutionProgramShape

fn clone(&self) -> ReusableExecutionProgramShape

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for ReusableExecutionProgramShape

impl Debug for ReusableExecutionProgramShape

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for ReusableExecutionProgramShape

fn deserialize<D>(deserializer: D) -> Result<Self, D::Error>

where D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for ReusableExecutionProgramShape

impl Hash for ReusableExecutionProgramShape

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl Ord for ReusableExecutionProgramShape

fn cmp(&self, other: &ReusableExecutionProgramShape) -> Ordering

This method returns an Ordering between self and other.

fn max(self, other: Self) -> Self

where Self: Sized,

Compares and returns the maximum of two values.

fn min(self, other: Self) -> Self

where Self: Sized,

Compares and returns the minimum of two values.

fn clamp(self, min: Self, max: Self) -> Self

where Self: Sized,

Restrict a value to a certain interval.

impl PartialEq for ReusableExecutionProgramShape

fn eq(&self, other: &ReusableExecutionProgramShape) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl PartialOrd for ReusableExecutionProgramShape

fn partial_cmp(&self, other: &ReusableExecutionProgramShape) -> Option<Ordering>

This method returns an ordering between self and other values if one exists.

fn lt(&self, other: &Rhs) -> bool

Tests less than (for self and other) and is used by the < operator.

fn le(&self, other: &Rhs) -> bool

Tests less than or equal to (for self and other) and is used by the <= operator.

fn gt(&self, other: &Rhs) -> bool

Tests greater than (for self and other) and is used by the > operator.

fn ge(&self, other: &Rhs) -> bool

Tests greater than or equal to (for self and other) and is used by the >= operator.

impl Serialize for ReusableExecutionProgramShape

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for ReusableExecutionProgramShape