Skip to main content

ChatModel

Trait ChatModel 

Source
pub trait ChatModel:
    Send
    + Sync
    + Debug {
    // Required method
    fn chat(
        &self,
        request: ChatRequest,
    ) -> BoxFuture<'_, Result<ChatStream, LlmError>>;
}
Expand description

A chat-capable model endpoint.

Required Methods§

Source

fn chat( &self, request: ChatRequest, ) -> BoxFuture<'_, Result<ChatStream, LlmError>>

Start a streaming chat completion.

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§