Struct RunOptions 

pub struct RunOptions {
    pub format: Format,
    pub system: Option<String>,
    pub temperature: Option<f64>,
    pub top_p: Option<f64>,
    pub max_tokens: Option<u32>,
}

Options passed to high-level LlmWeb methods. All fields are optional; use struct-update syntax to set only what you need:

RunOptions {
    format: Format::Markdown,
    temperature: Some(0.0),
    ..Default::default()
}

Fields

format: Format

system: Option<String>

Override the default system prompt. None = use the built-in prompt appropriate to the method (SYSTEM_PROMPT / CODEGEN_SYSTEM / RECIPE_SYSTEM).

temperature: Option<f64>

0.0 = deterministic, higher = more random.

top_p: Option<f64>

Nucleus-sampling threshold.

max_tokens: Option<u32>

Hard cap on output tokens.

Implementations

impl RunOptions

pub fn new(format: Format) -> Self

Shorthand for RunOptions { format, ..Default::default() }.

Trait Implementations

impl Clone for RunOptions

fn clone(&self) -> RunOptions

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RunOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for RunOptions

fn default() -> RunOptions

Returns the “default value” for a type.