Skip to main content

stream_generate_with_options

aimx

Function stream_generate_with_options 

Source 
pub fn stream_generate_with_options<P>(
    prompt: P,
    options: &GenerationOptions,
) -> Result<ResponseStream, Error>
where
    P: TryInto<Prompt>,
    P::Error: Into<Error>,
Expand description

MLX-style top-level streaming helper with explicit generation options.

ยงErrors

Returns every error documented by stream_generate. It can also return Error::InvalidTemperature or Error::InvalidMaxTokens when options contains out-of-range values.