Skip to main content

respond_with_options

Function respond_with_options 

Source
pub async fn respond_with_options<P>(
    prompt: P,
    options: &GenerationOptions,
) -> Result<String, Error>
where P: TryInto<Prompt>, P::Error: Into<Error>,
Expand description

Like respond but allows tuning generation via GenerationOptions.

ยงErrors

Returns every error documented by respond. It can also return Error::InvalidTemperature or Error::InvalidMaxTokens when options contains out-of-range values.