Struct CompletionRequest 

pub struct CompletionRequest {
    pub model: String,
    pub messages: Vec<ChatMessage>,
    pub max_tokens: Option<u32>,
    pub temperature: Option<f32>,
    pub system: Option<String>,
    pub tools: Vec<ToolDefinition>,
    pub stop: Vec<String>,
    pub metadata: HashMap<String, String>,
}

An LLM completion request.

Fields

model: String

Model identifier (e.g., “gpt-4”, “claude-3-opus”, “llama-3-70b”).

messages: Vec<ChatMessage>

Messages in the conversation.

max_tokens: Option<u32>

Maximum tokens to generate.

temperature: Option<f32>

Temperature (0.0 = deterministic, 1.0 = creative).

system: Option<String>

System prompt.

tools: Vec<ToolDefinition>

Tool/function definitions (for function calling).

stop: Vec<String>

Stop sequences.

metadata: HashMap<String, String>

Request metadata (for tracking, routing).

Implementations

impl CompletionRequest

pub fn new(model: impl Into<String>, user_message: impl Into<String>) -> Self

Create a simple completion request.

pub fn with_system(self, system: impl Into<String>) -> Self

Add a system prompt.

pub fn with_max_tokens(self, max: u32) -> Self

Set max tokens.

pub fn with_temperature(self, temp: f32) -> Self

Set temperature.

pub fn with_tool(self, tool: ToolDefinition) -> Self

Add a tool definition.

Trait Implementations

impl Clone for CompletionRequest

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CompletionRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CompletionRequest

fn default() -> Self

Returns the “default value” for a type.