Struct ChatRequest 

pub struct ChatRequest {
    pub messages: Vec<Message>,
    pub temperature: Option<f32>,
    pub max_tokens: Option<u32>,
    pub tools: Option<Vec<ToolDefinition>>,
    pub tool_choice: Option<String>,
    pub response_format: Option<ResponseFormat>,
    pub cancel_token: Option<CancellationToken>,
}

Chat request parameters

Fields

messages: Vec<Message>

Ordered chat history sent to the model.

temperature: Option<f32>

Optional sampling temperature.

max_tokens: Option<u32>

Optional response token limit.

tools: Option<Vec<ToolDefinition>>

Optional tool definitions exposed to the model.

tool_choice: Option<String>

Optional provider-specific tool choice mode.

response_format: Option<ResponseFormat>

Optional structured output format hint.

cancel_token: Option<CancellationToken>

Optional cancellation token for aborting in-flight requests. When set and cancelled, streaming responses will stop at the next SSE boundary.

Implementations

impl ChatRequest

pub fn new(messages: Vec<Message>) -> ChatRequest

Create a request from a message list.

pub fn with_tools(self, tools: Vec<ToolDefinition>) -> ChatRequest

Attach tool definitions to the request.

Trait Implementations

impl Clone for ChatRequest

fn clone(&self) -> ChatRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ChatRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for ChatRequest

fn default() -> ChatRequest

Returns the “default value” for a type.