Struct AnthropicCompatibleChatModel

pub struct AnthropicCompatibleChatModel { /* private fields */ }

An chat model that uses Anthropic’s API for the a remote chat model.

Implementations

impl AnthropicCompatibleChatModel

pub fn builder() -> AnthropicCompatibleChatModelBuilder<false>

Create a new builder for the Anthropic compatible chat model.

Trait Implementations

impl ChatModel for AnthropicCompatibleChatModel

fn add_messages_with_callback<'a>( &'a self, session: &'a mut Self::ChatSession, messages: &[ChatMessage], sampler: GenerationParameters, on_token: impl FnMut(String) -> Result<(), Self::Error> + Send + Sync + 'static, ) -> impl Future<Output = Result<(), Self::Error>> + Send + 'a

Add messages to the chat session with a callback that is called for each token.

impl Clone for AnthropicCompatibleChatModel

fn clone(&self) -> AnthropicCompatibleChatModel

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl CreateChatSession for AnthropicCompatibleChatModel

type ChatSession = AnthropicCompatibleChatSession

The type of chat session.

type Error = AnthropicCompatibleChatModelError

The type of error the chat session may return during operations.

fn new_chat_session(&self) -> Result<Self::ChatSession, Self::Error>

Create a new chat session for this model.

impl Debug for AnthropicCompatibleChatModel

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.