Struct Agent 

#[non_exhaustive]
pub struct Agent<M: CompletionModel> {
    pub name: Option<String>,
    pub model: M,
    pub preamble: String,
    pub static_context: Vec<Document>,
    pub static_tools: Vec<String>,
    pub temperature: Option<f64>,
    pub max_tokens: Option<u64>,
    pub additional_params: Option<Value>,
    pub dynamic_context: Vec<(usize, Box<dyn VectorStoreIndexDyn>)>,
    pub dynamic_tools: Vec<(usize, Box<dyn VectorStoreIndexDyn>)>,
    pub tools: ToolSet,
}

Struct representing an LLM agent. An agent is an LLM model combined with a preamble (i.e.: system prompt) and a static set of context documents and tools. All context documents and tools are always provided to the agent when prompted.

Example

use rig::{completion::Prompt, providers::openai};

let openai = openai::Client::from_env();

let comedian_agent = openai
    .agent("gpt-4o")
    .preamble("You are a comedian here to entertain the user using humour and jokes.")
    .temperature(0.9)
    .build();

let response = comedian_agent.prompt("Entertain me!")
    .await
    .expect("Failed to prompt the agent");

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

name: Option<String>

Name of the agent used for logging and debugging

model: M

Completion model (e.g.: OpenAI’s gpt-3.5-turbo-1106, Cohere’s command-r)

preamble: String

System prompt

static_context: Vec<Document>

Context documents always available to the agent

static_tools: Vec<String>

Tools that are always available to the agent (identified by their name)

temperature: Option<f64>

Temperature of the model

max_tokens: Option<u64>

Maximum number of tokens for the completion

additional_params: Option<Value>

Additional parameters to be passed to the model

dynamic_context: Vec<(usize, Box<dyn VectorStoreIndexDyn>)>

List of vector store, with the sample number

dynamic_tools: Vec<(usize, Box<dyn VectorStoreIndexDyn>)>

Dynamic tools

tools: ToolSet

Actual tool implementations

Trait Implementations

impl<M: CompletionModel> Chat for Agent<M>

async fn chat( &self, prompt: impl Into<Message> + Send, chat_history: Vec<Message>, ) -> Result<String, PromptError>

Send a prompt with optional chat history to the underlying completion model.

impl<M: CompletionModel> Completion<M> for Agent<M>

async fn completion( &self, prompt: impl Into<Message> + Send, chat_history: Vec<Message>, ) -> Result<CompletionRequestBuilder<M>, CompletionError>

Generates a completion request builder for the given prompt and chat_history. This function is meant to be called by the user to further customize the request at prompt time before sending it.

impl<M: CompletionModel> Prompt for &Agent<M>

fn prompt( &self, prompt: impl Into<Message> + Send, ) -> PromptRequest<'_, Standard, M>

Send a simple prompt to the underlying completion model.

impl<M: CompletionModel> Prompt for Agent<M>

fn prompt( &self, prompt: impl Into<Message> + Send, ) -> PromptRequest<'_, Standard, M>

Send a simple prompt to the underlying completion model.

impl<M> StreamingChat<M, <M as CompletionModel>::StreamingResponse> for Agent<M>

where M: CompletionModel + 'static, M::StreamingResponse: GetTokenUsage,

fn stream_chat( &self, prompt: impl Into<Message> + Send, chat_history: Vec<Message>, ) -> StreamingPromptRequest<'_, M>

Stream a chat with history to the model

impl<M: CompletionModel> StreamingCompletion<M> for Agent<M>

async fn stream_completion( &self, prompt: impl Into<Message> + Send, chat_history: Vec<Message>, ) -> Result<CompletionRequestBuilder<M>, CompletionError>

Generate a streaming completion from a request

impl<M> StreamingPrompt<M, <M as CompletionModel>::StreamingResponse> for Agent<M>

where M: CompletionModel + 'static, M::StreamingResponse: GetTokenUsage,

fn stream_prompt( &self, prompt: impl Into<Message> + Send, ) -> StreamingPromptRequest<'_, M>

Stream a simple prompt to the model

impl<M: CompletionModel> Tool for Agent<M>

const NAME: &'static str = "agent_tool"

The name of the tool. This name should be unique.

type Error = PromptError

The error type of the tool.

type Args = AgentToolArgs

The arguments type of the tool.

type Output = String

The output type of the tool.

async fn definition(&self, _prompt: String) -> ToolDefinition

A method returning the tool definition. The user prompt can be used to tailor the definition to the specific use case.

async fn call(&self, args: Self::Args) -> Result<Self::Output, Self::Error>

The tool execution method. Both the arguments and return value are a String since these values are meant to be the output and input of LLM models (respectively)

fn name(&self) -> String

A method returning the name of the tool.