wesichain-server 0.3.0

Rust-native LLM agents & chains with resumable ReAct workflows
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43

# wesichain-server

Axum HTTP server for exposing Wesichain agents and chains as REST/streaming APIs.

Part of the [wesichain](https://github.com/wesichain/wesichain) LLM agent framework.

## Installation

```toml
[dependencies]
wesichain-server = "0.3"
```

## Quick Start

```rust
use wesichain_server::{AgentRouter, ServerConfig};

#[tokio::main]
async fn main() -> Result<(), Box<dyn std::error::Error>> {
    let config = ServerConfig::builder()
        .bind("0.0.0.0:8080")
        .bearer_token(std::env::var("API_TOKEN").ok())
        .build();

    AgentRouter::new(config)
        .run()
        .await?;
    Ok(())
}
```

## Features

- **Bearer auth** — optional `Authorization: Bearer <token>` middleware
- **Rate limiting** — configurable request-per-second limits via Tower
- **SSE streaming** — `/invoke/stream` endpoint using `text/event-stream`
- **JSON invoke** — `/invoke` endpoint for synchronous calls
- **Body size limit** — configurable max request body size

## License

Apache-2.0 OR MIT