Struct InferenceWriter 

pub struct InferenceWriter<O> { /* private fields */ }

Communication channel for an inference task, allowing the app to send outputs and errors back to the session.

Implementations

impl<O> InferenceWriter<O>

pub fn with_observer(self, observer: Arc<dyn InferenceWriterObserver>) -> Self

pub fn write(&self, output: O) -> Result<(), InferenceWriterError>

Respond with an output item. This can be called multiple times to emit multiple items.

pub fn error<E>(&self, error: E) -> Result<(), InferenceWriterError>

where E: Into<Box<dyn Error + Send + Sync>>,

Signal an error on the inference.

Trait Implementations

impl<O> Drop for InferenceWriter<O>

When the InferenceWriter is dropped, it signals that the inference has finished, allowing the channel to perform any necessary cleanup or finalization.

fn drop(&mut self)

Executes the destructor for this type.