Struct CompletionModelHandle 

pub struct CompletionModelHandle<'a> {
    pub inner: Arc<dyn CompletionModelDyn + 'a>,
}

Wraps a CompletionModel in a dyn-compatible way for AgentBuilder.

Fields

inner: Arc<dyn CompletionModelDyn + 'a>

Trait Implementations

impl<'a> Clone for CompletionModelHandle<'a>

fn clone(&self) -> CompletionModelHandle<'a>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl CompletionModel for CompletionModelHandle<'_>

type Response = ()

The raw response type returned by the underlying completion model.

type StreamingResponse = ()

The raw response type returned by the underlying completion model when streaming.

fn completion( &self, request: CompletionRequest, ) -> impl Future<Output = Result<CompletionResponse<Self::Response>, CompletionError>> + Send

Generates a completion response for the given completion request.

fn stream( &self, request: CompletionRequest, ) -> impl Future<Output = Result<StreamingCompletionResponse<Self::StreamingResponse>, CompletionError>> + Send

fn completion_request( &self, prompt: impl Into<Message>, ) -> CompletionRequestBuilder<Self>

Generates a completion request builder for the given prompt.