Struct ProviderRequest 

pub struct ProviderRequest {
    pub messages: Vec<Message>,
    pub system_prompt: String,
    pub tools: Vec<ToolSchema>,
    pub model: String,
    pub max_tokens: u32,
    pub temperature: Option<f64>,
    pub enable_caching: bool,
    pub tool_choice: ToolChoice,
    pub metadata: Option<Value>,
    pub cancel: CancellationToken,
}

A provider-agnostic request.

Fields

messages: Vec<Message>

system_prompt: String

tools: Vec<ToolSchema>

model: String

max_tokens: u32

temperature: Option<f64>

enable_caching: bool

tool_choice: ToolChoice

Controls whether/how the model should use tools.

metadata: Option<Value>

Metadata to send with the request (e.g., user_id for Anthropic).

cancel: CancellationToken

Cancellation token for interrupting the in-flight streaming HTTP read. Providers must race byte_stream.next().await against cancel.cancelled() so that the spawned streaming task exits promptly when the user presses Escape or Ctrl+C. Background callers (memory extraction, consolidation) can pass CancellationToken::new() for an uncancellable request.