Struct Seating 

pub struct Seating { /* private fields */ }

Which lane each seat of a turn’s batch carries: the index is the seat, the value is the lane. max_lanes is the extent of the lane axis, fixed for the life of the state, so an op sizing a buffer on first eval knows how wide to make it – a turn seating one lane of many still needs the full width.

A lane appears at most once, which is what makes a stream’s state sequential: two seats of one turn cannot both advance the same lane. A model with no session-scoped state has nothing to address, so its seating is inert.

Seats and lanes both index axis 0 – of the turn’s tensors and of a laned state’s buffers respectively. A runtime seating more than one lane is what must have checked that axis 0 of every stateful node is the model’s batch axis; ops only assert that their input carries one stream per seat.

Implementations

impl Seating

pub fn new( max_lanes: usize, lanes: impl IntoIterator<Item = LaneId>, ) -> TractResult<Seating>

pub fn single() -> Seating

The seating of a state one stream owns: one lane wide, that lane seated. Every turn has a seating, and this is what an unbatched turn is.

pub fn max_lanes(&self) -> usize

pub fn lanes(&self) -> &[LaneId]

pub fn occupancy(&self) -> usize

Seats filled this turn, i.e. the extent of the batch axis of the tensors flowing through it.

pub fn address(&self, ix: usize) -> (Option<usize>, Option<usize>)

Where seat ix reads its stream and writes its state: the seat on axis 0 of the turn’s tensors, the lane on axis 0 of the state’s buffers. Both are absent when the state is one lane wide, as its buffers then have no lane axis and axis 0 of the tensors carries data rather than streams.

Trait Implementations

impl Clone for Seating

fn clone(&self) -> Seating

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Seating

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for Seating

impl PartialEq for Seating

fn eq(&self, other: &Seating) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Seating