embacle-server 0.19.4

Unified OpenAI-compatible REST API + MCP server for embacle LLM runners
Documentation
# embacle-server

Unified OpenAI-compatible REST API + MCP server that proxies requests to [embacle](https://github.com/dravr-ai/dravr-embacle) LLM runners. Any client that speaks the OpenAI chat completions API or MCP protocol can use it without modification.

## Install

```bash
cargo install embacle-server
```

## Usage

```bash
# Start with default provider on localhost:3000
embacle-server

# Specify provider and bind address
embacle-server --provider claude_code --port 8080 --host 0.0.0.0

# MCP-only mode via stdio (for editor/client integration)
embacle-server --transport stdio --provider copilot
```

## Endpoints

| Method | Path | Description |
|--------|------|-------------|
| `POST` | `/v1/chat/completions` | Chat completion (streaming and non-streaming) |
| `GET` | `/v1/models` | List available providers and models |
| `GET` | `/health` | Per-provider readiness check |
| `POST` | `/mcp` | MCP Streamable HTTP (JSON-RPC 2.0) |

## Model Routing

The `model` field determines which provider handles the request. Use a `provider:model` prefix to target a specific runner, or pass a bare model name to use the server's default.

```bash
# Explicit provider
curl http://localhost:3000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{"model": "claude:opus", "messages": [{"role": "user", "content": "hello"}]}'

# Default provider
curl http://localhost:3000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{"model": "gpt-4o", "messages": [{"role": "user", "content": "hello"}]}'
```

## Multiplex

Pass an array of models to fan out the same prompt to multiple providers concurrently:

```bash
curl http://localhost:3000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{"model": ["copilot:gpt-4o", "claude:opus"], "messages": [{"role": "user", "content": "hello"}]}'
```

Streaming is not supported for multiplex requests.

## Tool Calling

`/v1/chat/completions` accepts OpenAI-style `tools` and `tool_choice` and returns
`tool_calls`. Two execution models are supported via the `tool_execution` field:

- `"client"` (default) β€” the model's `tool_calls` are returned to you to execute
  and resubmit, the standard OpenAI flow.
- `"server"` β€” the server runs an autonomous agent loop, executing tool calls
  against its own configured MCP tool servers and returning the final answer.

When the underlying provider streams (`"stream": true`) and tools are requested,
tool calls are streamed incrementally as OpenAI `tool_calls` deltas.

### Server-side tool execution (MCP)

Configure downstream MCP tool servers (built on the official `rmcp` client, requires
the default `mcp-tools` feature). Either in `embacle.toml`:

```toml
[[mcp_servers]]
name = "filesystem"
command = "npx"
args = ["-y", "@modelcontextprotocol/server-filesystem", "/tmp"]

[[mcp_servers]]
name = "github"
command = "uvx"
args = ["mcp-server-github"]
env = { GITHUB_TOKEN = "..." }
```

…or via the `EMBACLE_MCP_SERVERS` environment variable (a JSON array of the same
objects). Then ask the server to run the tools itself:

```bash
curl http://localhost:3000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "copilot",
    "tool_execution": "server",
    "messages": [{"role": "user", "content": "What files are in /tmp?"}]
  }'
```

The server discovers each configured server's tools on startup. If the request also
supplies `tools`, server-side execution is restricted to the named subset.

## Authentication

Optional. Set `EMBACLE_API_KEY` to require bearer token auth. When unset, all requests are allowed (localhost dev mode).

```bash
EMBACLE_API_KEY=my-secret embacle-server
curl http://localhost:3000/v1/models -H "Authorization: Bearer my-secret"
```

## Requirements

At least one supported CLI tool must be installed and authenticated:
- `claude` (Claude Code)
- `copilot` (GitHub Copilot)
- `cursor-agent` (Cursor Agent)
- `opencode` (OpenCode)
- `gemini` (Gemini CLI)
- `codex` (Codex CLI)
- `goose` (Goose CLI)
- `cline` (Cline CLI)
- `cn` (Continue CLI)
- `oz` (Warp)
- `kiro-cli` (Kiro CLI)
- `kilo` (Kilo Code)

## License

Apache-2.0 β€” see [LICENSE-APACHE](../../LICENSE-APACHE).

Full project documentation: [github.com/dravr-ai/dravr-embacle](https://github.com/dravr-ai/dravr-embacle)