Struct BoxedCompletionConstraintsForType

pub struct BoxedCompletionConstraintsForType<T> { /* private fields */ }

A constraints for CreateDefaultCompletionConstraintsForType that work with boxed TextCompletionModels.

Trait Implementations

impl<T> ModelConstraints for BoxedCompletionConstraintsForType<T>

type Output = T

The type of the output of the constraints.

impl<T> StructuredTextCompletionModel<BoxedCompletionConstraintsForType<T>> for BoxedStructuredTextCompletionModel<T>

fn stream_text_with_callback_and_parser<'a>( &'a self, session: &'a mut Self::Session, text: &str, sampler: GenerationParameters, parser: BoxedCompletionConstraintsForType<T>, on_token: impl FnMut(String) -> Result<(), Self::Error> + Send + Sync + 'static, ) -> impl Future<Output = Result<T, Self::Error>> + Send + 'a

Generate text with the given prompt and the given constraints.