Struct LLMResponse 

pub struct LLMResponse<C>
where
    C: for<'de> Deserialize<'de> + Default + Clone + Send,
{
    pub content: C,
    pub tool_calls: Vec<ToolCall>,
    pub is_complete: bool,
}

Response from an LLM including generated content and tool calls.

This struct represents a complete response from an LLM, which may include generated text content and/or requests to call tools.

Examples

use runtime::llm::{LLMResponse, ToolCall};

let response = LLMResponse {
    content: "Let me calculate that for you".to_string(),
    tool_calls: vec![
        ToolCall {
            name: "calculator".to_string(),
            input: serde_json::json!({"operation": "add", "a": 2, "b": 2}),
        }
    ],
    is_complete: false,
};

Fields

content: C

The generated content from the LLM

tool_calls: Vec<ToolCall>

Tool calls requested by the LLM (supports multiple calls)

is_complete: bool

Whether the response is complete (false if tool calls need to be executed)

Trait Implementations

impl<C> Clone for LLMResponse<C>

where C: for<'de> Deserialize<'de> + Default + Clone + Send + Clone,

fn clone(&self) -> LLMResponse<C>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<C> Debug for LLMResponse<C>

where C: for<'de> Deserialize<'de> + Default + Clone + Send + Debug,

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<C> Default for LLMResponse<C>

where C: for<'de> Deserialize<'de> + Default + Clone + Send + Default,

fn default() -> LLMResponse<C>

Returns the “default value” for a type.

impl<C> LLMResponseTrait<C> for LLMResponse<C>

where C: for<'de> Deserialize<'de> + Default + Clone + Send,

fn new(content: C, tool_calls: Vec<ToolCall>, is_complete: bool) -> Self

Creates a new LLM response.

fn is_complete(&self) -> bool

Returns whether the response is complete.

fn tool_calls(&self) -> Vec<ToolCall>

Returns the tool calls requested by the LLM.

fn content(&self) -> C

Returns the content of the response.

impl<C> Serialize for LLMResponse<C>

where C: for<'de> Deserialize<'de> + Default + Clone + Send + Serialize,

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.