Struct ResponseFuture 

pub struct ResponseFuture { /* private fields */ }

Future that returns the inference response.
The request can be cancelled by dropping this structure.

Also the input buffers assigned to the request can be returned via get_input_release.

Implementations

impl ResponseFuture

pub fn blocking_recv(self) -> Result<Response, InferenceError>

Blocking await to call outside of asynchronous contexts.

Panics

This function panics if called within an asynchronous execution context.

pub fn get_input_release(&mut self) -> InputRelease

Get the future to return the input buffers assigned to the Request.

NOTE: this function should be called at most once. Otherwise it will return garbage.
Note that input buffer can be released in any time from the start of the inference to the end of it.

Trait Implementations

impl Future for ResponseFuture

Awaiting on this structure will returt result of the inference: Ok(Response) or Err(InferenceError).

type Output = Result<Response, InferenceError>

The type of value produced on completion.

fn poll(self: Pin<&mut Self>, cx: &mut Context<'_>) -> Poll<Self::Output>

Attempts to resolve the future to a final value, registering the current task for wakeup if the value is not yet available.