Struct Request 

pub struct Request {
    pub model: CompactString,
    pub messages: Vec<Message>,
    pub think: bool,
    pub tools: Option<Vec<Tool>>,
    pub tool_choice: Option<ToolChoice>,
    pub usage: bool,
}

A chat completion request.

Contains everything needed to make an LLM call: model, messages, tools, and streaming hints. Provider implementations convert this to their wire format via From<Request>.

Fields

model: CompactString

The model to use.

messages: Vec<Message>

The conversation messages.

think: bool

Whether to enable thinking.

tools: Option<Vec<Tool>>

The tools available for this request.

tool_choice: Option<ToolChoice>

Controls which tool is called by the model.

usage: bool

Whether to return usage information in stream mode.

Implementations

impl Request

pub fn new(model: impl Into<CompactString>) -> Self

Create a new request for the given model.

pub fn with_messages(self, messages: Vec<Message>) -> Self

Set the messages for this request.

pub fn with_tools(self, tools: Vec<Tool>) -> Self

Set the tools for this request.

pub fn with_tool_choice(self, tool_choice: ToolChoice) -> Self

Set the tool choice for this request.

Trait Implementations

impl Clone for Request

fn clone(&self) -> Request

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Request

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Request

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for Request

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for Request

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.