Struct kalosm_language_model::StreamTextBuilder

pub struct StreamTextBuilder<'a, M: Model> { /* private fields */ }

A builder for the ModelExt::stream_text method.

Implementations

impl<'a, M: Model> StreamTextBuilder<'a, M>

pub fn new( prompt: &'a str, self_: &'a M, future: fn(_: &'a M, _: &'a str, _: GenerationParameters) -> Pin<Box<dyn Future<Output = Result<M::TextStream>> + Send + 'a>> ) -> Self

Create a new builder to return from the ModelExt::stream_text method.

pub fn with_generation_parameters( self, parameters: GenerationParameters ) -> Self

Set the generation parameters to use when generating text. This will override any parameters set by other methods.

pub fn with_temperature(self, temperature: f32) -> Self

Set the temperature to use when generating text.

pub fn with_mu(self, mu: f32) -> Self

Set the mu to use when generating text.

pub fn with_tau(self, tau: f32) -> Self

Set the tau to use when generating text.

pub fn with_eta(self, eta: f32) -> Self

Set the eta to use when generating text.

pub fn with_repetition_penalty(self, repetition_penalty: f32) -> Self

Set the repetition penalty to use when generating text.

pub fn with_repetition_penalty_range( self, repetition_penalty_range: u32 ) -> Self

Set the repetition penalty range to use when generating text.

pub fn with_max_length(self, max_length: u32) -> Self

Set the maximum length to use when generating text.

pub fn with_stop_on(self, stop_on: impl Into<Option<String>>) -> Self

Set the string to stop on when generating text.

Trait Implementations

impl<'a, M: Model> IntoFuture for StreamTextBuilder<'a, M>

type Output = Result<<M as Model>::TextStream, Error>

The output that the future will produce on completion.

type IntoFuture = Pin<Box<dyn Future<Output = <StreamTextBuilder<'a, M> as IntoFuture>::Output> + Send + 'a>>

Which kind of future are we turning this into?

fn into_future(self) -> Self::IntoFuture

Creates a future from a value.