pub struct InferenceOverrideState;Expand description
Accumulated inference override for the current step.
Written by SetInferenceOverride handler. Read and cleared by orchestrator.
Trait Implementations§
Source§impl StateKey for InferenceOverrideState
impl StateKey for InferenceOverrideState
const KEY: &'static str = "__runtime.inference_override_state"
Source§const MERGE: MergeStrategy = MergeStrategy::Commutative
const MERGE: MergeStrategy = MergeStrategy::Commutative
Parallel merge strategy. Default:
Exclusive (conflict on concurrent writes).type Value = InferenceOverrideStateValue
type Update = InferenceOverrideStateAction
fn apply(value: &mut Self::Value, update: Self::Update)
fn encode(value: &Self::Value) -> Result<Value, StateError>
fn decode(value: Value) -> Result<Self::Value, StateError>
Auto Trait Implementations§
impl Freeze for InferenceOverrideState
impl RefUnwindSafe for InferenceOverrideState
impl Send for InferenceOverrideState
impl Sync for InferenceOverrideState
impl Unpin for InferenceOverrideState
impl UnsafeUnpin for InferenceOverrideState
impl UnwindSafe for InferenceOverrideState
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more