Struct CallOptions 

pub struct CallOptions {
    pub temperature: Option<f32>,
    pub max_tokens: Option<u32>,
    pub stop_sequences: Option<Vec<String>>,
    pub top_p: Option<f32>,
    pub model_override: Option<String>,
    pub tool_choice: Option<ToolChoice>,
    pub response_format: Option<ResponseFormat>,
    pub tags: Vec<String>,
}

Options for LLM invocations

These options override default settings on the ChatModel instance for a single invocation.

Fields

temperature: Option<f32>

Sampling temperature (0.0 to 1.0)

max_tokens: Option<u32>

Maximum tokens to generate

stop_sequences: Option<Vec<String>>

Sequences that will stop generation

top_p: Option<f32>

Nucleus sampling threshold (0.0 to 1.0)

model_override: Option<String>

Override the model name for this call

tool_choice: Option<ToolChoice>

Tool selection strategy

response_format: Option<ResponseFormat>

Response format for structured output

tags: Vec<String>

Tags for streaming metadata and filtering.

Tags are propagated into stream events as [MessageStreamMetadata::tags]. The "nostream" tag causes [EventEmitter::should_emit] to suppress streaming events for this call.

Trait Implementations

impl Clone for CallOptions

fn clone(&self) -> CallOptions

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CallOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CallOptions

fn default() -> CallOptions

Returns the “default value” for a type.