vex-llm 1.7.0

LLM provider integrations for VEX
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43

# vex-llm

LLM provider integrations for the VEX Protocol.

## Supported Providers

- **OpenAI** - GPT-4, GPT-3.5, etc.
- **Ollama** - Local LLM inference
- **DeepSeek** - DeepSeek models
- **Mistral** - Mistral AI models
- **Mock** - Testing provider
- **Secure WASM Sandbox** - Isolate tool execution with `wasmtime`
- **OOM Protection** - Strict 10MB output memory limits

## Installation

```toml
[dependencies]
[dependencies]
vex-llm = "1.3.0"

# With OpenAI support
vex-llm = { version = "0.1", features = ["openai"] }
```

## Quick Start

```rust
use vex_llm::{LlmProvider, OllamaProvider, LlmRequest};

#[tokio::main]
async fn main() -> Result<(), Box<dyn std::error::Error>> {
    let provider = OllamaProvider::new("http://localhost:11434");
    let request = LlmRequest::new("Hello, world!");
    let response = provider.complete(request).await?;
    println!("{}", response.content);
    Ok(())
}
```

## License

Apache-2.0 License - see [LICENSE](../../LICENSE) for details.