Struct ChatRequest 

pub struct ChatRequest {
    pub model: String,
    pub messages: Vec<Message>,
    pub system: Option<String>,
    pub max_tokens: Option<u32>,
    pub temperature: Option<f64>,
    pub top_p: Option<f64>,
    pub tools: Vec<ToolSpec>,
    pub stream: bool,
    pub trace_id: Option<String>,
    pub cancel: CancellationFlag,
}

One canonical chat request — provider-neutral. Per-provider adapters translate to the wire JSON the provider expects.

Fields

model: String

Empty string → backend uses its default_model().

messages: Vec<Message>

system: Option<String>

System prompt — Anthropic puts it in a top-level field; OpenAI & compats prepend a system message to the messages array.

max_tokens: Option<u32>

temperature: Option<f64>

Temperature; ignored when the resolved model is locked-params.

top_p: Option<f64>

tools: Vec<ToolSpec>

stream: bool

false → call complete(). true → call stream() and consume the chunk stream incrementally.

trace_id: Option<String>

Trace ID propagated from the calling flow step. Surfaces in tracing spans so log lines correlate.

cancel: CancellationFlag

§Fase 33.x.e — Cancellation flag observed INSIDE the reqwest body. Each per-provider Backend::stream() impl wraps its returned chunk stream with sse_streaming::cancel_aware so the next-chunk poll races a cancel.cancelled() future against the upstream HTTP body — when the flag fires the stream returns None within ≤100ms p95 + the dropped reqwest Response aborts the upstream HTTP request body.

Default is an uncancelled flag; adopters that don’t supply one get pre-33.x.e semantics (the stream runs to completion). Cloning is cheap (Arc-backed inside).

Trait Implementations

impl Clone for ChatRequest

fn clone(&self) -> ChatRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ChatRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ChatRequest

fn default() -> ChatRequest

Returns the “default value” for a type.