Struct BoxedStructuredTextCompletionModel

pub struct BoxedStructuredTextCompletionModel<T> { /* private fields */ }

A boxed BoxedStructuredTextCompletionModel.

Trait Implementations

impl<T: Clone> Clone for BoxedStructuredTextCompletionModel<T>

fn clone(&self) -> BoxedStructuredTextCompletionModel<T>

Returns a duplicate of the value.

const fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<T> CreateTextCompletionSession for BoxedStructuredTextCompletionModel<T>

type Session = BoxedTextCompletionSession

The type of the session that this model uses.

type Error = Box<dyn Error + Send + Sync>

The type of error this model may return during operations.

fn new_session(&self) -> Result<Self::Session, Self::Error>

Create a new session for this model.

impl<T> StructuredTextCompletionModel<BoxedCompletionConstraintsForType<T>> for BoxedStructuredTextCompletionModel<T>

fn stream_text_with_callback_and_parser<'a>( &'a self, session: &'a mut Self::Session, text: &str, sampler: GenerationParameters, parser: BoxedCompletionConstraintsForType<T>, on_token: impl FnMut(String) -> Result<(), Self::Error> + Send + Sync + 'static, ) -> impl Future<Output = Result<T, Self::Error>> + Send + 'a

Generate text with the given prompt and the given constraints.

impl<T> TextCompletionModel for BoxedStructuredTextCompletionModel<T>

fn stream_text_with_callback<'a>( &'a self, session: &'a mut Self::Session, text: &str, sampler: GenerationParameters, on_token: impl FnMut(String) -> Result<(), Self::Error> + Send + Sync + 'static, ) -> impl Future<Output = Result<(), Self::Error>> + Send + 'a

Generate text with the given prompt.