CompletionModelDyn

Trait CompletionModelDyn 

Source
pub trait CompletionModelDyn: WasmCompatSend + WasmCompatSync {
    // Required methods
    fn completion(
        &self,
        request: CompletionRequest,
    ) -> WasmBoxedFuture<'_, Result<CompletionResponse<()>, CompletionError>>;
    fn stream(
        &self,
        request: CompletionRequest,
    ) -> WasmBoxedFuture<'_, Result<StreamingCompletionResponse<FinalCompletionResponse>, CompletionError>>;
    fn completion_request(
        &self,
        prompt: Message,
    ) -> CompletionRequestBuilder<CompletionModelHandle<'_>>;
}
๐Ÿ‘ŽDeprecated since 0.25.0: DynClientBuilder and related features have been deprecated and will be removed in a future release. In this case, use CompletionModel instead.

Required Methodsยง

Source

fn completion( &self, request: CompletionRequest, ) -> WasmBoxedFuture<'_, Result<CompletionResponse<()>, CompletionError>>

๐Ÿ‘ŽDeprecated since 0.25.0: DynClientBuilder and related features have been deprecated and will be removed in a future release. In this case, use CompletionModel instead.
Source

fn stream( &self, request: CompletionRequest, ) -> WasmBoxedFuture<'_, Result<StreamingCompletionResponse<FinalCompletionResponse>, CompletionError>>

๐Ÿ‘ŽDeprecated since 0.25.0: DynClientBuilder and related features have been deprecated and will be removed in a future release. In this case, use CompletionModel instead.
Source

fn completion_request( &self, prompt: Message, ) -> CompletionRequestBuilder<CompletionModelHandle<'_>>

๐Ÿ‘ŽDeprecated since 0.25.0: DynClientBuilder and related features have been deprecated and will be removed in a future release. In this case, use CompletionModel instead.

Implementorsยง

Sourceยง

impl<T, R> CompletionModelDyn for T
where T: CompletionModel<StreamingResponse = R>, R: Clone + Unpin + GetTokenUsage + 'static,