Struct CompletionRequest 

pub struct CompletionRequest {
    pub preamble: Option<String>,
    pub chat_history: Vec<Message>,
    pub tools: Vec<ToolDefinition>,
    pub max_tokens: Option<u64>,
    pub additional_params: Option<Value>,
}

A request to stream one completion from a model.

This is the entire API surface providers must support; anything provider-specific (thinking configuration, beta flags, …) travels in additional_params or is applied by the provider itself.

Fields

preamble: Option<String>

The system prompt.

chat_history: Vec<Message>

The conversation so far, ending with the content to complete.

tools: Vec<ToolDefinition>

Definitions of the tools available to the model.

max_tokens: Option<u64>

Maximum number of output tokens. None uses the provider’s default.

additional_params: Option<Value>

Extra provider-specific request parameters, merged into the request by the provider.

Trait Implementations

impl Clone for CompletionRequest

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CompletionRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CompletionRequest

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for CompletionRequest

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for CompletionRequest

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for CompletionRequest

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for CompletionRequest