Trait ChatModel 

pub trait ChatModel: Send + Sync {
    // Required method
    fn chat<'life0, 'async_trait>(
        &'life0 self,
        request: ChatRequest,
    ) -> Pin<Box<dyn Future<Output = Result<ChatResponse, SynapseError>> + Send + 'async_trait>>
       where Self: 'async_trait,
             'life0: 'async_trait;

    // Provided method
    fn stream_chat(&self, request: ChatRequest) -> ChatStream<'_> { ... }
}

The core trait for language model providers. Implementations provide chat() for single responses and optionally stream_chat() for streaming.

Required Methods

fn chat<'life0, 'async_trait>( &'life0 self, request: ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatResponse, SynapseError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Provided Methods

fn stream_chat(&self, request: ChatRequest) -> ChatStream<'_>

Implementors