Trait OpState

Source

pub trait OpState:
    Debug
    + DynClone
    + Downcast
    + Send {
    // Required methods
    fn eval(
        &mut self,
        ctx: &EvalContext<'_>,
        op: &dyn Op,
        inputs: TVec<TValue>,
    ) -> TractResult<TVec<TValue>>;
    fn reset_lanes(&mut self, lanes: &[LaneId]) -> TractResult<()>;

    // Provided methods
    fn load_from(
        &mut self,
        _: &mut TurnState,
        _: &mut dyn Iterator<Item = TValue>,
    ) -> TractResult<()> { ... }
    fn save_to(&self, _: &mut Vec<TValue>) -> TractResult<()> { ... }
    fn init_tensor_fact(&self) -> Option<(String, TypedFact)> { ... }
    fn has_init_tensor_fact(&self) -> bool { ... }
    fn resolve_symbols(&mut self, _: &mut TurnState) -> TractResult<()> { ... }
}

Required Methods§

Source

fn eval( &mut self, ctx: &EvalContext<'_>, op: &dyn Op, inputs: TVec<TValue>, ) -> TractResult<TVec<TValue>>

Source

fn reset_lanes(&mut self, lanes: &[LaneId]) -> TractResult<()>

Discard what this state carries for lanes, so each can be handed to another stream. Required, with no default: an op holding per-lane state clears those rows, one holding none says so with Ok(()), and one that cannot serve several streams at once fails here – which is where a laned runtime finds out, since it resets every lane before the first turn.

Provided Methods§

Source

fn load_from( &mut self, _: &mut TurnState, _: &mut dyn Iterator<Item = TValue>, ) -> TractResult<()>

Source

fn save_to(&self, _: &mut Vec<TValue>) -> TractResult<()>

Source

fn init_tensor_fact(&self) -> Option<(String, TypedFact)>

Source

fn has_init_tensor_fact(&self) -> bool

Allocation-free predicate mirroring whether OpState::init_tensor_fact returns Some. The per-run symbol-resolution path queries this once for every stateful op on every run, so it must not call init_tensor_fact (which clones a String and a TypedFact) merely to test for presence. Any impl that overrides init_tensor_fact to return Some must override this to return true (and delegate it wherever init_tensor_fact is delegated), or its resolve_symbols will not run.