Struct UnifiedLLMRequest 

pub struct UnifiedLLMRequest {
    pub messages: Vec<UnifiedMessage>,
    pub response_schema: Option<Value>,
    pub config: Option<RequestConfig>,
}

A complete request to an LLM provider.

Bundles messages, optional response schema, and request configuration into a single structure that can be passed to any provider.

Basic Usage

use multi_llm::{UnifiedLLMRequest, UnifiedMessage};

let messages = vec![
    UnifiedMessage::system("You are a helpful assistant."),
    UnifiedMessage::user("Hello!"),
];

let request = UnifiedLLMRequest::new(messages);

With Configuration

use multi_llm::{UnifiedLLMRequest, UnifiedMessage, RequestConfig};

let messages = vec![UnifiedMessage::user("Hello!")];
let config = RequestConfig {
    temperature: Some(0.7),
    max_tokens: Some(1000),
    ..Default::default()
};

let request = UnifiedLLMRequest::with_config(messages, config);

Structured Output

For JSON-structured responses (useful for data extraction):

use multi_llm::{UnifiedLLMRequest, UnifiedMessage};

let messages = vec![UnifiedMessage::user("Extract the name and age.")];
let schema = serde_json::json!({
    "type": "object",
    "properties": {
        "name": {"type": "string"},
        "age": {"type": "integer"}
    },
    "required": ["name", "age"]
});

let request = UnifiedLLMRequest::with_schema(messages, schema);

Message Ordering

Use sort_messages() to order by priority and timestamp:

use multi_llm::{UnifiedLLMRequest, UnifiedMessage};

let messages = vec![
    UnifiedMessage::current_user("Hello!".to_string()),  // priority 30
    UnifiedMessage::system_instruction("Be helpful.".to_string(), None),  // priority 0
];

let mut request = UnifiedLLMRequest::new(messages);
request.sort_messages();  // System instruction now first

Fields

messages: Vec<UnifiedMessage>

All messages for this request.

Use sort_messages() to order by priority.

response_schema: Option<Value>

Optional JSON schema for structured output.

When provided, the LLM will attempt to return a response that conforms to this schema. Useful for data extraction tasks.

config: Option<RequestConfig>

Optional configuration overrides for this request.

When None, the provider’s default configuration is used.

Implementations

impl UnifiedLLMRequest

pub fn new(messages: Vec<UnifiedMessage>) -> Self

Create a new request with messages

pub fn with_schema(messages: Vec<UnifiedMessage>, schema: Value) -> Self

Create a new request with schema

pub fn with_config(messages: Vec<UnifiedMessage>, config: RequestConfig) -> Self

Create a new request with config

pub fn sort_messages(&mut self)

Sort messages by priority and timestamp

pub fn get_sorted_messages(&self) -> Vec<&UnifiedMessage>

Get messages sorted by priority (does not modify original)

pub fn get_system_messages(&self) -> Vec<&UnifiedMessage>

Get system messages

pub fn get_conversation_messages(&self) -> Vec<&UnifiedMessage>

Get non-system messages

pub fn get_cacheable_messages(&self) -> Vec<&UnifiedMessage>

Get cacheable messages

Trait Implementations

impl Clone for UnifiedLLMRequest

fn clone(&self) -> UnifiedLLMRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for UnifiedLLMRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for UnifiedLLMRequest

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for UnifiedLLMRequest

fn eq(&self, other: &UnifiedLLMRequest) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for UnifiedLLMRequest

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for UnifiedLLMRequest