agentsdk 0.7.0

An open-source Rust library for building AI-powered applications, inspired by the Vercel AI SDK. It provides a robust, type-safe, and easy-to-use interface for interacting with various Large Language Models (LLMs).
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133

# AGENTSDK

[![Docs](https://img.shields.io/badge/docs-latest-blue)](https://agentsdk.rs)
[![Build Status](https://github.com/dineshdb/agentsdk/actions/workflows/ci.yml/badge.svg)](https://github.com/dineshdb/agentsdk/actions/workflows/ci.yml)
[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
[![Issues](https://img.shields.io/github/issues/dineshdb/agentsdk)](https://github.com/dineshdb/agentsdk/issues)
[![PRs Welcome](https://img.shields.io/badge/PRs-welcome-brightgreen.svg)](https://github.com/dineshdb/agentsdk/pulls)

An open-source, **provider-agnostic** Rust library for building AI-powered
applications, inspired by the Vercel AI SDK. Type-safe, framework-friendly, and
ready to connect with **70+ AI providers**.

To learn more about how to use the AGENTSDK, check out our
[Documentation API Reference](https://docs.rs/agentsdk/latest).

## Features

- Agents & Tool Execution
- Prompt Templating
- Text Generation & Streaming
- Structured Output (JSON Schema)
- Embedding Model Support
- Compatible with [Vercel AI SDK UI](https://ai-sdk.dev/docs/ai-sdk-ui/overview)
  (React, Solid, Vue, Svelte, …)
- Supports 73+ providers, including Anthropic, Google, OpenAI, OpenRouter, xAI

## Installation

```bash
cargo add agentsdk
```

## Usage

Enable Providers of your choice such as OpenAI, Anthropic, Google, and
[more](https://agentsdk.rs/docs#model-providers)

### Example with OpenAI provider

```bash
cargo add agentsdk --features openai
```

### Basic Text Generation

```rust
use agentsdk::LanguageModelRequest;
use agentsdk::providers::OpenAI;

#[tokio::main]
async fn main() -> Result<(), Box<dyn std::error::Error>> {

    let openai = OpenAI::gpt_5();

    let result = LanguageModelRequest::builder()
        .model(openai)
        .prompt("What is the meaning of life?")
        .build()
        .generate_text() // or stream_text() for streaming
        .await?;

    println!("Response: {:?}", result.text());
    Ok(())
}
```

## Agents

### Defining a Tool

Use the `#[tool]` macro to expose a Rust function as a callable tool.

```rust
use agentsdk::Tool;
use agentsdk::tool;

#[tool]
/// Get the weather information given a location
pub fn get_weather(location: String) -> Tool {
    let weather = match location.as_str() {
        "Tokyo" => 80,
        _ => 70,
    };
    Ok(weather.to_string())
}
```

### Using Tools in an Agent

Register tools with an agent so the model can call them during its reasoning
loop.

```rust
use agentsdk::{LanguageModelRequest, utils::step_count_is};
use agentsdk::providers::OpenAI;

#[tokio::main]
async fn main() -> Result<(), Box<dyn std::error::Error>> {

    let result = LanguageModelRequest::builder()
        .model(OpenAI::gpt_4o())
        .system("You are a helpful assistant.")
        .prompt("What is the weather in New York?")
        .with_tool(get_weather())
        .stop_when(step_count_is(3)) // Limit agent loop to 3 steps
        .build()
        .generate_text()
        .await?;

    println!("Response: {:?}", result.text());
    Ok(())
}
```

```
### Prompts

The AGENTSDK prompt feature provides, file-based template system for managing AI prompts using the Tera template engine. It allows you to create reusable prompt templates with variable substitution, conditionals, loops, and template inclusion. See [Examples](https://agentsdk.rs/docs/concepts/prompt) for more template examples. Enable with `cargo add agentsdk --features prompt`

### Roadmap

- [ ] Image Model Request Support
- [ ] Voice Model Request Support
- [ ] Observability & OpenTelemetry (OTel) Support

## Contributing

We welcome contributions! Please see [CONTRIBUTING.md](./CONTRIBUTING.md) for guidelines.

## License

Licensed under the MIT License. See [LICENSE](./LICENSE) for details.
```