Struct Agent 

#[non_exhaustive]
pub struct Agent<M>
where
    M: CompletionModel,
{
    pub name: Option<String>,
    pub description: Option<String>,
    pub model: Arc<M>,
    pub preamble: Option<String>,
    pub static_context: Vec<Document>,
    pub temperature: Option<f64>,
    pub max_tokens: Option<u64>,
    pub additional_params: Option<Value>,
    pub tool_server_handle: ToolServerHandle,
    pub dynamic_context: Arc<RwLock<Vec<(usize, Box<dyn VectorStoreIndexDyn>)>>>,
    pub tool_choice: Option<ToolChoice>,
}

Struct representing an LLM agent. An agent is an LLM model combined with a preamble (i.e.: system prompt) and a static set of context documents and tools. All context documents and tools are always provided to the agent when prompted.

Example

use rig::{completion::Prompt, providers::openai};

let openai = openai::Client::from_env();

let comedian_agent = openai
    .agent("gpt-4o")
    .preamble("You are a comedian here to entertain the user using humour and jokes.")
    .temperature(0.9)
    .build();

let response = comedian_agent.prompt("Entertain me!")
    .await
    .expect("Failed to prompt the agent");

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

name: Option<String>

Name of the agent used for logging and debugging

description: Option<String>

Agent description. Primarily useful when using sub-agents as part of an agent workflow and converting agents to other formats.

model: Arc<M>

Completion model (e.g.: OpenAI’s gpt-3.5-turbo-1106, Cohere’s command-r)

preamble: Option<String>

System prompt

static_context: Vec<Document>

Context documents always available to the agent

temperature: Option<f64>

Temperature of the model

max_tokens: Option<u64>

Maximum number of tokens for the completion

additional_params: Option<Value>

Additional parameters to be passed to the model

tool_server_handle: ToolServerHandle

dynamic_context: Arc<RwLock<Vec<(usize, Box<dyn VectorStoreIndexDyn>)>>>

List of vector store, with the sample number

tool_choice: Option<ToolChoice>

Whether or not the underlying LLM should be forced to use a tool before providing a response.

Trait Implementations

impl<M> Chat for Agent<M>

where M: CompletionModel,

async fn chat( &self, prompt: impl Into<Message> + WasmCompatSend, chat_history: Vec<Message>, ) -> Result<String, PromptError>

Send a prompt with optional chat history to the underlying completion model.

impl<M> Clone for Agent<M>

where M: Clone + CompletionModel,

fn clone(&self) -> Agent<M>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<M> Completion<M> for Agent<M>

where M: CompletionModel,

async fn completion( &self, prompt: impl Into<Message> + WasmCompatSend, chat_history: Vec<Message>, ) -> Result<CompletionRequestBuilder<M>, CompletionError>

Generates a completion request builder for the given prompt and chat_history. This function is meant to be called by the user to further customize the request at prompt time before sending it.

impl<M> Prompt for &Agent<M>

where M: CompletionModel,

fn prompt( &self, prompt: impl Into<Message> + WasmCompatSend, ) -> PromptRequest<'_, Standard, M, ()>

Send a simple prompt to the underlying completion model.

impl<M> Prompt for Agent<M>

where M: CompletionModel,

fn prompt( &self, prompt: impl Into<Message> + WasmCompatSend, ) -> PromptRequest<'_, Standard, M, ()>

Send a simple prompt to the underlying completion model.

impl<M> StreamingChat<M, <M as CompletionModel>::StreamingResponse> for Agent<M>

where M: CompletionModel + 'static, <M as CompletionModel>::StreamingResponse: GetTokenUsage,

fn stream_chat( &self, prompt: impl Into<Message> + WasmCompatSend, chat_history: Vec<Message>, ) -> StreamingPromptRequest<M, ()>

Stream a chat with history to the model

impl<M> StreamingCompletion<M> for Agent<M>

where M: CompletionModel,

async fn stream_completion( &self, prompt: impl Into<Message> + WasmCompatSend, chat_history: Vec<Message>, ) -> Result<CompletionRequestBuilder<M>, CompletionError>

Generate a streaming completion from a request

impl<M> StreamingPrompt<M, <M as CompletionModel>::StreamingResponse> for Agent<M>

where M: CompletionModel + 'static, <M as CompletionModel>::StreamingResponse: GetTokenUsage,

fn stream_prompt( &self, prompt: impl Into<Message> + WasmCompatSend, ) -> StreamingPromptRequest<M, ()>

Stream a simple prompt to the model

impl<M> Tool for Agent<M>

where M: CompletionModel,

const NAME: &'static str = "agent_tool"

The name of the tool. This name should be unique.

type Error = PromptError

The error type of the tool.

type Args = AgentToolArgs

The arguments type of the tool.

type Output = String

The output type of the tool.

async fn definition(&self, _prompt: String) -> ToolDefinition

A method returning the tool definition. The user prompt can be used to tailor the definition to the specific use case.

async fn call( &self, args: <Agent<M> as Tool>::Args, ) -> Result<<Agent<M> as Tool>::Output, <Agent<M> as Tool>::Error>

The tool execution method. Both the arguments and return value are a String since these values are meant to be the output and input of LLM models (respectively)

fn name(&self) -> String

A method returning the name of the tool.