Struct BoxedChatConstraintsForType

pub struct BoxedChatConstraintsForType<T> { /* private fields */ }

A constraints for CreateDefaultChatConstraintsForType that work with boxed StructuredChatModels.

Trait Implementations

impl<T> ModelConstraints for BoxedChatConstraintsForType<T>

type Output = T

The type of the output of the constraints.

impl<T: 'static> StructuredChatModel<BoxedChatConstraintsForType<T>> for BoxedStructuredChatModel<T>

fn add_message_with_callback_and_constraints<'a>( &'a self, session: &'a mut Self::ChatSession, messages: &[ChatMessage], sampler: GenerationParameters, constraints: BoxedChatConstraintsForType<T>, on_token: impl FnMut(String) -> Result<(), Self::Error> + Send + Sync + 'static, ) -> impl Future<Output = Result<T, Self::Error>> + Send + 'a

Add messages to the chat session with a callback that is called for each token and a constraints the response must follow.