Struct BoxedTextCompletionModel

pub struct BoxedTextCompletionModel { /* private fields */ }

A boxed TextCompletionModel.

Trait Implementations

impl Clone for BoxedTextCompletionModel

fn clone(&self) -> BoxedTextCompletionModel

Returns a duplicate of the value.

const fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl CreateTextCompletionSession for BoxedTextCompletionModel

type Session = BoxedTextCompletionSession

The type of the session that this model uses.

type Error = Box<dyn Error + Send + Sync>

The type of error this model may return during operations.

fn new_session(&self) -> Result<Self::Session, Self::Error>

Create a new session for this model.

impl TextCompletionModel for BoxedTextCompletionModel

fn stream_text_with_callback<'a>( &'a self, session: &'a mut Self::Session, text: &str, sampler: GenerationParameters, on_token: impl FnMut(String) -> Result<(), Self::Error> + Send + Sync + 'static, ) -> impl Future<Output = Result<(), Self::Error>> + Send + 'a

Generate text with the given prompt.