Struct LLMRequestOptions 

pub struct LLMRequestOptions {
    pub model: Option<String>,
    pub max_tokens: Option<i64>,
    pub system_prompt: Option<String>,
}

Per-request LLM options that override session defaults

Fields

model: Option<String>

Model to use for this request

max_tokens: Option<i64>

Maximum tokens for the response

system_prompt: Option<String>

System prompt override

Trait Implementations

impl Clone for LLMRequestOptions

fn clone(&self) -> LLMRequestOptions

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LLMRequestOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for LLMRequestOptions

fn default() -> LLMRequestOptions

Returns the “default value” for a type.