Skip to main content

generate_with_options

Function generate_with_options 

Source
pub async fn generate_with_options<P>(
    prompt: P,
    options: &GenerationOptions,
) -> Result<String, Error>
where P: TryInto<Prompt>, P::Error: Into<Error>,
Expand description

MLX-style top-level generation helper with explicit generation options.

ยงErrors

Returns every error documented by respond_with_options.