Struct ChatRequest 

pub struct ChatRequest {
    pub messages: Vec<Message>,
    pub tools: Vec<ToolDef>,
    pub temperature: Option<f32>,
    pub max_tokens: Option<u32>,
    pub response_format: ResponseFormat,
    pub stop: Vec<String>,
    pub timeout: Option<Duration>,
}

Chat completion request.

Fields

messages: Vec<Message>

Conversation history.

tools: Vec<ToolDef>

Tools available for the model to call.

temperature: Option<f32>

Sampling temperature.

max_tokens: Option<u32>

Maximum response tokens.

response_format: ResponseFormat

Output format hint.

stop: Vec<String>

Stop sequences.

timeout: Option<Duration>

Per-request deadline. Provider should abort if exceeded.

Implementations

impl ChatRequest

pub fn new(messages: Vec<Message>) -> Self

Build a request with the supplied messages and no tools.

pub fn builder() -> ChatRequestBuilder

Start building a request; messages are sent in the order they are added.

use klieo_core::llm::ChatRequest;
let req = ChatRequest::builder().system("be terse").user("hi").build();
assert_eq!(req.messages.len(), 2);

Trait Implementations

impl Clone for ChatRequest

fn clone(&self) -> ChatRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ChatRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.