Struct BoxedStructuredChatModel

pub struct BoxedStructuredChatModel<T> { /* private fields */ }

A boxed StructuredChatModel.

Trait Implementations

impl<T> ChatModel for BoxedStructuredChatModel<T>

fn add_messages_with_callback<'a>( &'a self, session: &'a mut Self::ChatSession, messages: &[ChatMessage], sampler: GenerationParameters, on_token: impl FnMut(String) -> Result<(), Self::Error> + Send + Sync + 'static, ) -> impl Future<Output = Result<(), Self::Error>> + Send + 'a

Add messages to the chat session with a callback that is called for each token.

impl<T: Clone> Clone for BoxedStructuredChatModel<T>

fn clone(&self) -> BoxedStructuredChatModel<T>

Returns a duplicate of the value.

const fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<T> CreateChatSession for BoxedStructuredChatModel<T>

type ChatSession = BoxedChatSession

The type of chat session.

type Error = Box<dyn Error + Send + Sync>

The type of error the chat session may return during operations.

fn new_chat_session(&self) -> Result<Self::ChatSession, Self::Error>

Create a new chat session for this model.

impl<T> CreateDefaultChatConstraintsForType<T> for BoxedStructuredChatModel<T>

where T: 'static,

type DefaultConstraints = BoxedChatConstraintsForType<T>

The default constraints for this type that work with this chat model.

fn create_default_constraints() -> Self::DefaultConstraints

Create Self::DefaultConstraints which parse the type T for this chat model.

impl<T: 'static> StructuredChatModel<BoxedChatConstraintsForType<T>> for BoxedStructuredChatModel<T>

fn add_message_with_callback_and_constraints<'a>( &'a self, session: &'a mut Self::ChatSession, messages: &[ChatMessage], sampler: GenerationParameters, constraints: BoxedChatConstraintsForType<T>, on_token: impl FnMut(String) -> Result<(), Self::Error> + Send + Sync + 'static, ) -> impl Future<Output = Result<T, Self::Error>> + Send + 'a

Add messages to the chat session with a callback that is called for each token and a constraints the response must follow.