Struct CompletionRequest 

pub struct CompletionRequest {
    pub model: String,
    pub system: Option<Arc<str>>,
    pub messages: Vec<Message>,
    pub tools: Vec<ToolSchema>,
    pub tool_choice: ToolChoice,
    pub sampling: SamplingParams,
    pub hosted_capabilities: HostedCapabilities,
}

Input for a single generation request.

Fields

model: String

system: Option<Arc<str>>

System prompt. Uses Arc<str> instead of String: the request is cloned in the turn main loop (sent to the provider, fanned out with the LlmCallStarted event), and deep-copying a long system prompt repeatedly is expensive; Arc reduces clone to a reference-count bump.

messages: Vec<Message>

tools: Vec<ToolSchema>

tool_choice: ToolChoice

sampling: SamplingParams

hosted_capabilities: HostedCapabilities

The set of hosted capabilities the provider may use in this turn.

Determined once at session startup (see

Reused from the session marker when assembling each turn’s request. The provider adapter uses this to decide whether to advertise a hosted tool on the wire.

Trait Implementations

impl Clone for CompletionRequest

fn clone(&self) -> CompletionRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CompletionRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for CompletionRequest

fn deserialize<__D>( __deserializer: __D, ) -> Result<CompletionRequest, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for CompletionRequest

fn eq(&self, other: &CompletionRequest) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for CompletionRequest

fn serialize<__S>( &self, __serializer: __S, ) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for CompletionRequest