Struct LanedStateHandle 

pub struct LanedStateHandle { /* private fields */ }

One stream’s view of a LanedRunnable: the lane it holds, and the queue to the worker. Cloning it shares the lane – clones are the same stream, and the lane goes back to the table once the last of them is dropped.

Trait Implementations

impl Clone for LanedStateHandle

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LanedStateHandle

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl State for LanedStateHandle

fn run(&mut self, inputs: TVec<TValue>) -> TractResult<TVec<TValue>>

fn runnable(&self) -> &dyn Runnable

fn resolve_symbol(&mut self, symbol: &Symbol, value: i64) -> TractResult<()>

Pin a symbol for the coming turn. A pulsed plan needs the stream length on the turn carrying the last, partial pulse: the input tensor is padded to a full pulse, so its shape can not carry it.

fn seat(&mut self, seating: Seating) -> TractResult<()>

Seat the lanes carrying the coming turn’s streams, one lane per seat of axis 0 of its tensors. A turn seating more than one lane needs axis 0 of every stateful node to be the model’s batch axis.

fn reset_lanes(&mut self, lanes: &[LaneId]) -> TractResult<()>

Drop the session state lanes hold, handing them to new streams.

fn input_count(&self) -> usize

fn output_count(&self) -> usize