Struct ModelVariant 

pub struct ModelVariant {
    pub batch: usize,
    pub seq: usize,
    pub past_seq: Option<usize>,
    pub phase: ModelPhase,
    pub extra: Vec<(u32, usize)>,
}

Concrete shape bucket for compile-once / specialize-at-runtime workflows.

Fields

batch: usize

seq: usize

past_seq: Option<usize>

phase: ModelPhase

extra: Vec<(u32, usize)>

Extra dynamic symbols beyond batch/seq/past (e.g. custom ragged axes).

Implementations

impl ModelVariant

pub fn prefill(batch: usize, seq: usize) -> Self

pub fn decode(batch: usize, past_seq: usize, new_tokens: usize) -> Self

Single-step decode: seq is the new token count (often 1); past_seq is KV length.

pub fn encoder(batch: usize, seq: usize) -> Self

pub fn with_extra(self, symbol: u32, size: usize) -> Self

pub fn cache_key(&self) -> u64

Stable cache key: phase + bound leading dims + extra symbols.

pub fn dim_binding(&self) -> DimBinding

Symbol bindings used by crate::dynamic::bind_graph / compile specialization.

Trait Implementations

impl Clone for ModelVariant

fn clone(&self) -> ModelVariant

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelVariant

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for ModelVariant

impl PartialEq for ModelVariant

fn eq(&self, other: &ModelVariant) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for ModelVariant