Skip to main content

ModelHandle

Type Alias ModelHandle 

Source
pub type ModelHandle = Handle<Completion>;
Expand description

A completion model: call, stream, capabilities, label.

Aliased Type§

pub struct ModelHandle { /* private fields */ }

Implementations§

Source§

impl ModelHandle

Source

pub fn capabilities(&self) -> ProviderCapabilities

The capability snapshot the handler advertises now.

Source

pub fn label(&self) -> ModelRef

The model’s label as the handler advertises it now.

Source

pub fn call( &self, request: CompletionRequest, ) -> impl Future<Output = Result<<Completion as Family>::Answer, ErrorReport>> + WasmCompatSend + 'static

A unary completion.

Source

pub fn stream(&self, request: CompletionRequest) -> CompletionStream

A streamed completion, folded by the returned stream.