Please check the build logs for more information.
See Builds for ideas on how to fix a failed build, or Metadata for how to configure docs.rs builds.
If you believe this is docs.rs' fault, open an issue.
Choreographr
What is Choreographr?
Choreographr is an all purpose extensible AI agent system written entirely in Rust. It has a client/server architecture and can run many sessions simulataneously. It can be run locally or in the cloud. LLM generated code can be run in a sandboxed RISC-V VM for complete security and observability.
All Purpose
Choreographr is a all-purpose agent. It can be used for software development, a personal / business agent, or as a research tool. It can run on your desktop or in the cloud.
Community
Join the Choreographr Community on Telegram for announcements, questions, show-and-tell, and development chatter.
Client / Server Architecture
Choreographr was designed from the beginning to have a separation of concerns between the server software that actually runs the sessions and the clients that can connect and disconnect any time.
The client can either run on the same computer as the server agent (via local socket), or the server can be anywhere else on your local network or the Internet. When not connecting locally the client connects to the server via Noise-IK encrypted TCP connection. Because the server can live anywhere and is reachable over encrypted TCP, it can also be accessed from mobile devices — for example, chatting with your agent on the go via the choreo-im Telegram bridge.
Client/server communication is encoded in MessagePack in named mode — a self-describing, compact binary format with broad language support (struct field names and enum variant names travel on the wire, so the format is evolution-safe for future mobile/web/third-party clients). Postcard remains only on internal Rust-only channels: the RISC-V VM↔host protocol and encrypted credential storage.
Currently the primary client is choreo-tui - a fullscreen terminal UI.
Other clients being developed:
choreo-gui— GUI built with Dioxus - just a placeholder for now, it will support Linux, macOS, Windows, Android and iOS.choreo-im— instant-messaging bridge (Telegram, more platforms coming) - chat with your agent on the go!choreo-acp— ACP bridge so ACP-compatible editors (Claude Code, Cline, …) can drive Choreographr sessions over JSON-RPC.choreographr— Choreographr servers will be able to connect to other servers to deploy work elsewhere.
RISC-V Virtual Machine
The LLM can invoke the RISC-V VM (powered by CKB VM) by either providing a Rust snippet, or pre-compiled bytecode. Other languages will be supported in future.
This has 2 main purposes:
- a tool call scripting language - the LLM can quickly write a little script to call tools with custom logic
- a complete replacement for the shell tool. Giving the LLM direct access to the shell is potentially very dangerous. Disabling the shell tool and doing everything via the VM provides complete control and observability.
Multiple live sessions
Each server can run multiple sessions simultaneously (only limited by system resources). Sessions are stored in the database and only "woken-up" when a client connects to them.
Rather than having a multi-session terminal multiplexor, you can manage all your sessions directly from a client program.
Sessions have undo/redo functionality. If an LLM is mis-prompted it is often better to remove the prompt than to prompt more to try to "fix it".
Hierarchical Sessions
Many agents support the concept of "subagents". Choreographr has "subsessions". This enables work to be broken up into manageable chunks and potentially worked on in parallel.
In Choreographr, the LLM or VM can start new sessions that will report back once they are finished. Subsessions are real sessions that can be interacted with like any other session. The user can pause them and provide additional prompting. Subsessions can invoke their own subsessions as necessary.
Agent databases
LLMs can create persistent key/value databases. The LLM / VM can store data and retrieve it at a later time.
High performance Multithreaded Architecture
Currently the codebase doesn't use any async code - this reduces the complexity of the codebase significantly. It uses real kernel threads with event loops and message passing. Mutable state is not shared between threads (except for the message passing). Everything is event driven without polling.
Extensions may require tokio to use certain crates.
choreo-tui is entirely event driven, and runs in immediate mode. The terminal is updated immediately upon receiving a keystroke or networking event. There is no maximum framerate. Additionally, it has O(1) scrolling and O(1) streaming. It is ultra-smooth!
Encrypted Keystore
Credentials are encrypted per-credential with ECDH (X25519) + HKDF +
AES-256-GCM before being stored in the redb database, so only the holder
of the daemon's private key can decrypt them. Identity keys live in
~/.config/choreographr/ — identity.pk (private), public.pk (public),
and optionally identity.pk.enc (passphrase-encrypted). The daemon starts
locked and only decrypts credentials into memory after /unlock.
Maximum model compatibility
Currently Choreographr supports the following model APIs:
- OpenAI
- Chat Completions - used by almost all model providers
- Responses - including programmatic tool calling (gpt-5.6+ models)
- Anthropic
- Gemini
Other major APIs will be supported in future:
- AWS Bedrock Runtime
- Google Vertex AI
- Azure OpenAI (classic)
- AWS SageMaker
- gRPC-based inference servers (Triton, ONNX Runtime, TensorRT-LLM)
- Cohere native API
- AI21 native API
- Ollama native /api/chat
Future Functionality
Extensions
Extensions communicate with the choreographr server via a local socket. They will be able to hook into the operation of the server, for example to expose new tool calls. Similar to MCP (also supported). There will be blockchain extensions that enable reading and writing to EVM / Solana / Polkadot blockchains.
Stored VM programs
Once the tool call ABI has stabilized, it will be possible for compiled Rust programs to be stored and executed when necessary.
Cron
Programs will be able to run automatically at designated times.
Sandboxing
While the VM itself is a perfect sandbox, tools are executed outside of this sandbox for example, if the shell tool is enabled. An OS-level sandbox will be required.
On Linux, Landlock will be used. On macOS, Seatbelt. Windows does not have a good solution for this yet.
Advanced Context Management
The session context needs to be divided between permanent and temporary context. Permanent context should be append-only (except when undoing) this ensures maximum cache hit rate.
Currently, as with most AI agents, if the LLM wants to see a file it issues the read_file tool. This adds it permanently into the session context. A better solution is to have an add_to_context tool with the option to add it to the permanent or temporary context. If it is added the to temporary context it can be removed later by a remove_from_context tool.
Git Worktree Support
To get the most out of subsessions, they need to run in parallel on the same codebase. The problem is that they will interfere with each other's work. The solution is for each subsession to work on its own branch in its own directory. This is where Git Worktrees come in. Once a subsession has finished committing in its own branch, the parent session can merge it into its own branch. Any merge conflicts can be resolved by the LLM.
The problem with worktrees is that programming languages such as Rust can have many gigabytes of build artifacts. If each worktree has to regenerate these it consumes CPU bandwidth, I/O bandwidth, storage space and is generally very slow. Copying the artifacts from the parent's tree reduces the CPU bandwidth, but is still a big problem.
The solution is to use CoW filesystems such as BTRFS so the file is only copied if it is re-generated by the subsession.
Looping
A common scenario in agentic coding is to manually "loop" over the codebase changes until a certain goal is met. For example, after a new feature has been implemented a new session can be prompted to check the changes for bugs, potential refactorings, optimizations, security issues. The LLM will then make some recommendations. It will then be prompted to implement these. Once this is complete a new session is created to do it again. This process repeats until the LLM says it is ready, or only complains about very minor issues.
Choreographr will have an option to automate this process, so it can be left alone to complete the whole process without interaction.
Comparison to other agents
Feature matrix against other AI agent projects, ordered by GitHub ⭐ descending after Choreographr.
| Feature | Choreo | openclaw | hermes | opencode | codex | pi | goose | langgraph | buzz | openwork | t3code | OpenMinis | mercury | tau | maka-agent | zero | turnstone |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Language | Rust | TypeScript | Python | TypeScript | Rust | TypeScript | Rust | Python | Rust | TypeScript | TypeScript | Swift/Kotlin | TypeScript | Python | TypeScript | Go | Python |
| Daemon + multi-client | ✅ | ✅ | — | server | — | — | server | — | ✅ | ✅ | ✅ | — | ✅ daemon | — | ✅ | — | server |
| Concurrent sessions | ✅ daemon | ✅ gateway | ✅ capped | ✅ server | ✅ threads | — | ✅ server | ✅ framework | ✅ | — | ✅ | — | ✅ | — | ✅ | ✅ pool | ✅ |
| Providers | 79/3 proto | 40+ | 34 | 15 | 1 (OpenAI) | 42/9 proto | 39 | agnostic | agnostic | agnostic | 5 (drives) | 8 | 6 | 28 | multi | 36 | 5 |
| OAuth | coming | ✅ | ✅ 6× | ✅ | ✅ ChatGPT | ✅ | — | — | — | ✅ | — | ✅ | ✅ device | ✅ | ✅ subs | ✅ | ✅ MCP |
| Credential rotation/fallback | retry only | ✅ failover | ✅ pool | — | — | — | — | — | — | — | — | ✅ fallback | ✅ | — | — | — | ✅ |
| Tool permission gating | coming | ✅ | env-only | ✅ | ✅ | — | ✅ | — | — | — | ✅ | ✅ | ✅ | — | ✅ | ✅ | ✅ judge |
| Compaction | coming | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | — | ✅ | — | — | ✅ | — | ✅ | ✅ | ✅ | ✅ |
| Sandbox | RISC-V VM · Landlock/Seatbelt coming soon | Docker/SSH | Docker/SSH | — | ✅ sandbox | — | — | — | — | — | — | iSH/PRoot | — | — | — | seccomp eng. | OpenShell |
| Subagents | subsessions | swarm | delegation | ✅ | ✅ | — | — | subgraphs | agent pool | — | — | — | ✅ | — | ✅ graph | specialists | workstreams |
| Skills (SKILL.md) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | — | — | — | ✅ | — | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| MCP client | ✅ | ✅ | ✅ | ✅ | ✅ | — | ✅ | — | ✅ | ✅ meta | — | ✅ | — | — | ✅ | ✅ | ✅ (OAuth) |
| ACP | bridge | bridge | ✅ | ✅ | — | — | server | — | harness | — | — | — | — | — | — | ✅ | — |
| IM surfaces | Telegram | 25+ | 20+ | — | — | — | — | — | chat natively | — | — | — | CLI/Web/Telegram | — | — | — | 2 |
| Web search | coming | ✅ | ✅ | ✅ | ✅ | — | — | — | — | — | — | — | ✅ | — | ✅ | ✅ | ✅ |
| Hooks/lifecycle | coming | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | — | ✅ | — | — | — | — | — | — | ✅ | — |
| Plugins | coming | ✅ | ✅ | ✅ | ✅ | ✅ | — | — | — | ✅ | — | — | — | — | — | ✅ | — |
| Cron/scheduling | coming | — | ✅ | — | — | — | ✅ | — | ✅ | — | — | — | ✅ | — | ✅ | ✅ | — |
| Long-term memory | coming | ✅ | ✅ | — | ✅ | — | — | ✅ | — | — | — | ✅ | ✅ | — | — | — | ✅ |
| Encrypted creds | ✅ unique | ✅ | — | — | ✅ keyring | — | ✅ keyring | — | NIP auth | ✅ | ✅ | ✅ keychain | — | 0600 | — | ✅ | ✅ Fernet |
| Storage | redb | SQLite | SQLite | event src | SQLite | JSONL | SQLite | SQLite/Postgres | Postgres | fs | — | SQLite | SQLite+JSONL | JSONL | SQLite | fs JSONL | SQL/Postgres |
| Metrics | ✅ | ✅ OTel | — | — | ✅ OTel | telemetry | telemetry | — | — | — | — | — | — | — | — | — | ✅ |
| Undo/redo | ✅ | — | ✅ | — | — | branch | — | time-travel | — | — | — | — | — | — | — | rewind | replay |
| Context fingerprints | ✅ | — | — | — | — | — | — | — | — | — | — | — | — | — | — | partial | ✅ |
Concurrent sessions
Choreographr's headline concurrency: one daemon runs many sessions at once — each
session is an independent control thread with at most one request worker, sessions
persist to redb and only wake when a client attaches, any number of clients can
subscribe to the same session, and subsessions (children) run their own loops in
parallel and can be interacted with independently. How the other agents compare:
- openclaw — Gateway hosts many concurrent chat sessions; per-session actor
queues serialize ACP operations while the swarm tool fans out parallel subagents
(default
maxConcurrent: 8). - hermes — Gateway processes messages concurrently via asyncio; a
max_concurrent_sessionscap (default unset = unlimited) limits simultaneous active chat sessions, enforced via a cross-process lease file, with concurrent turns on different sessions kept isolated. - opencode — Server mode (
opencode serve) exposes sessions over HTTP; each session runs one prompt at a time (aSessionBusyErrorrejects overlapping runs) but many sessions run concurrently, and the TUI / web / desktop all attach to the same server. - codex — App-server
ThreadManagertracks a tree of threads; each thread has its own serialized listener, subagents spawn as child threads (spawn_subagent), and concurrent requests are tracked with unique in-flight IDs. - pi — Single-process CLI: sessions are JSONL files you resume or fork; within a
session, tool calls default to parallel execution (
toolExecution: "parallel") but only one session runs per process. - goose — SessionManager over SQLite; the desktop app lists and switches many sessions, and the ACP server multiplexes them, but each session handles one prompt at a time.
- langgraph — A framework rather than a daemon: durable execution keyed by
thread_id, subgraphs, and parallel graph branches give the building blocks; concurrency is up to the hosting app. - buzz — Relay/ACP harness supports unlimited concurrent sessions
(
BUZZ_AGENT_MAX_SESSIONS; one prompt per session at a time) with up to 8 parallel tool calls per turn, and agents are first-class members of shared channels. - openwork — Desktop app with per-workspace session groups; it exposes capabilities over MCP rather than running many sessions in parallel itself.
- t3code — A control surface: one app drives Codex, Claude Code, Cursor, Grok Build and OpenCode concurrently, each with its own sessions/panes.
- OpenMinis — On-device agent with separate workspaces; tool calls run
concurrently (up to 10 via
TaskGroup) and background sessions are supported, but it is a mobile app rather than a multi-session server. - mercury — Background daemon with a pool of sub-agent workers (auto-scaled by CPU cores, overridable); the main agent queues messages while busy, and board batches run concurrently per batch.
- tau — Single-session teaching harness: append-only JSONL sessions, resume and branch, parallel tool calls within a turn, but one session at a time.
- maka-agent — Runtime serves several concurrent runs;
ChildAgentRunLimiter(FIFO permits) caps real child-agent executions, and the Agent Graph runs a supervisor that wakes on checkpoints. - zero — Daemon mode supervises a bounded pool of headless
zero execworker processes (default pool size 4) routing multiple sessions over a local socket, with read-only tool calls executed concurrently in a turn and specialist subagents as separate sessions. - turnstone — Server runs many workstreams concurrently; each workstream gets its own worker thread (queue-or-spawn decided under a lock), children spawn via a coordinator, and parallel tool batches are judge-approved before execution.
Install
Prebuilt releases ship exactly four binaries — choreographr choreo-tui choreo-im choreo-acp (choreo-mcp is a library-only crate and ships no
binary) — for x86_64 Linux and macOS (Apple Silicon). All installs
below use prebuilt binaries; no Rust or Zig toolchain is required.
macOS
Homebrew (recommended). The choreographr/choreographr tap provides a
prebuilt formula — no toolchain needed:
brew services registers a launchd agent, so the daemon starts at login
and is kept alive — but only because you asked; nothing is ever auto-enabled.
Alternatives:
- GitHub Releases tarball — download
choreographr-0.1.0-aarch64-apple-darwin.tar.gzfrom the releases page and put the four binaries on yourPATH. The binaries are unsigned, so Gatekeeper quarantines them: clear the attribute withxattr -dr com.apple.quarantine /path/to/choreographr, or right-click → Open once. - curl installer — pinned version, SHA-256 verified:
curl -fsSL https://choreographr.com/install.sh | sh - cargo binstall — installs the prebuilt tarball, no toolchain:
cargo binstall choreographr - cargo install — builds from source; needs Zig at build time. Installs the
whole suite (daemon + TUI + IM + ACP — the root package owns all four
[[bin]]targets;default-runonly affectscargo run):cargo install choreographr
Linux
- Debian / Ubuntu — install the
.debfrom the release:sudo apt install ./choreographr-0.1.0-x86_64.deb - Fedora / RHEL / openSUSE — install the
.rpmfrom the release:sudo dnf install ./choreographr-0.1.0-x86_64.rpm - Arch Linux (AUR) — the prebuilt
choreographr-binpackage:paru -S choreographr-bin(oryay -S choreographr-bin) - Any distro — tarball + installer, or cargo:
curl -fsSL https://choreographr.com/install.sh | sh·cargo binstall choreographr(prebuilt, no toolchain — fetches the static musl tarball from GitHub Releases; on a glibc host binstall may need--target x86_64-unknown-linux-musl, verify at release time) ·cargo install choreographr(source build, needs Zig — installs the whole suite:choreographr,choreo-tui,choreo-im,choreo-acp)
Running the daemon
In 0.1 the daemon is a user service that you start — installers place the service file but never enable it. One of:
The non-Homebrew launchd plist expects /opt/homebrew/bin/choreographr —
edit its ProgramArguments if your binaries live elsewhere. Once the daemon
is up, attach a client (choreo-tui, choreo-im, choreo-acp) and follow
First conversation below. The daemon listens on the
Unix socket /tmp/Choreographr.sock and stores its data under
~/.local/share/choreographr/ (see Configuration).
Zig? Only source builds need it. Homebrew, the
.deb/.rpm, the AUR-binpackage, the tarball, andcargo binstallall use prebuilt binaries —cargo installand the Build from source path need the Zig toolchain.
Build from source
Requires a Rust toolchain — minimum supported Rust version (MSRV) is 1.91 — and a Zig toolchain (brew install zig), which choreographr needs to compile the zlob glob/walker dependency.
Start the daemon:
RUST_LOG takes precedence over the CLI flags:
RUST_LOG=debug
Then a client — the suite binaries live in the root package, selected with --bin;
the desktop GUI is a separate crate (choreo-gui):
First conversation
- Configure an account in
~/.config/choreographr/accounts.toml(see Configuration) and add an API key with/add-key <service> <api_key>. - Select the account with
/account <name>and start prompting.
┌──────────────┐ Unix socket / ┌──────────────┐ HTTP/SSE ┌────────────────────┐
│ choreo-tui │◄───────────────────►│ │◄──────────────►│ OpenAI-compatible │
│ (terminal) │ │ │ ├────────────────────┤
├──────────────┤ │ │◄──────────────►│ Anthropic Messages│
│ choreo-gui │◄───────────────────►│ choreographr │ ├────────────────────┤
│ (desktop) │ Noise-IK TCP │ (daemon) │◄──────────────►│ Google Gemini │
├──────────────┤ │ │ └────────────────────┘
│ choreo-im │◄───────────────────►│ │
│ (IM bridge) │ │ │
├──────────────┤ │ │
│ choreo-acp │◄───────────────────►│ │ MCP subprocess servers
│ (ACP bridge)│ └──────────────┘ RISC-V VM sandbox
└──────────────┘ redb database
Crates
A Rust workspace of thirteen crates (resolver = "3"):
See ARCHITECTURE.md for a deep dive into the daemon's internals — threading model, provider architecture, tool system, and session data model.
| Crate | Description |
|---|---|
choreographr |
Workspace root — the suite installer. Declares the four binaries (choreographr choreo-tui choreo-im choreo-acp); cargo run -p choreographr / cargo install choreographr default to the daemon binary via default-run |
choreo-daemon |
The core engine — binary choreographr. Unix socket server that validates credentials, manages persistent sessions (with sub-sessions and working directories), runs requests with a tool-call loop, and streams responses |
choreo-ai-protocols |
Provider protocols — OpenAI-compatible, Anthropic Messages, and Google Gemini clients, the ProviderClient trait, and the provider catalog (79+ providers) |
choreo-proto |
Framed binary protocol (MessagePack named + length prefix) shared between clients and daemon |
choreo-keystore |
X25519 keypair + ECDH/AES-256-GCM crypto library for encrypted credentials |
choreo-transport |
Noise-IK encrypted transport over TCP |
choreo-mcp |
MCP (Model Context Protocol) client — spawns subprocess servers, discovers tools, dispatches calls over JSON-RPC stdio |
choreo-acp |
ACP (Agent Communication Protocol) bridge — translates JSON-RPC 2.0 over stdin/stdout into choreo-proto messages so ACP-compatible editors can drive sessions |
choreo-tui |
Full-screen terminal UI client (ratatui + crossterm) |
choreo-gui |
Desktop GUI client (Dioxus) |
choreo-im |
Instant messaging bridge (Telegram) |
choreo-client-core |
Shared parsing, markdown, image assembly, and daemon-message dispatch for UI clients |
choreo-markdown |
Markdown parser and HTML renderer (pulldown-cmark + ammonia) |
Concepts
Agent loop (harness). The daemon drives a server-side loop that repeatedly
sends conversation history and available tools to the LLM, executes any tool
calls the model requests, appends the results, and loops until the model
produces a final answer, is cancelled, or hits an error (subject to the
daemon-wide iteration cap; 0 = unlimited). Each session keeps a responsive control thread and runs request work
in a separate worker thread. The client only sees ToolCallStarted /
ToolCallFinished lifecycle events, keeping it simple.
Session / subsession. A session is a persisted conversation with its own
message history, model, and working directory. Sessions form
a parent-child tree, support multiple concurrent client attachments, and survive
daemon restarts via an embedded redb database. A subsession is a child
session spawned by the spawn_subsession tool — it inherits the parent's
working directory, runs its own full agent loop independently, and returns its
output as the parent's tool result. Subsessions persist permanently.
Tool. A function the LLM can call to interact with the outside world (read
files, make HTTP requests, run git commands, classify PDFs and convert them to
Markdown, query blockchains, post to X, etc.). Tools implement the Tool trait
(name, group, description, JSON Schema, fn execute) and are registered in a
ToolRegistry at daemon startup.
Tool group. Tools are organized into groups (core, git, shell, x,
vm, db, mcp). Only core, git, and shell are active by default. The
model can activate additional groups with load_tools and deactivate them with
unload_tools. Groups are a discovery mechanism, not access control — the
RISC-V VM always has access to all tools.
Skill. A filesystem-based extension following the Agent Skills standard — a
SKILL.md file with YAML frontmatter (name, description) placed under
.agents/skills/<name>/. At session creation, skill names and descriptions are
listed in the system prompt. When the model calls load_skill, the full
instruction body is injected into the conversation (progressive disclosure).
Reasoning round-trip. Reasoning text is both displayed in the TUI (collapsible per-turn "Reasoning" section) and, for several providers, sent back to the model on the next request — the tool-call loop otherwise fails with a 400. The daemon captures the provider's reasoning payload verbatim at the parse boundary (an opaque, provider-owned artifact), stores it on the turn, and re-emits it per provider rules on the next request:
- Anthropic — thinking blocks (with encrypted
signature) andredacted_thinkingblocks are echoed back, complete and unmodified, alongsidetool_useblocks (a missing or altered block is a 400). - DeepSeek / Kimi (OpenAI-compatible chat) —
reasoning_contentis passed back on every assistant tool-call message when the request carriestools. - Gemini — the encrypted thought-step
thoughtSignaturevalues are sent back (the summary text stays display-only). - OpenAI / xAI Responses — reasoning continuity is chained across user
turns via
previous_response_id(the server retains the reasoning items in the chain; a fresh chained turn sends only the new user message, and opaque reasoning items are re-emitted intoinputon non-chained conversions).
Display-only reasoning (providers/fields that expose no reusable payload) is
never replayed. Artifacts are model-bound: after a mid-session model switch
(/model), old turns' reasoning is not replayed — a turn produced under
the previous model never has its payload sent to the new one.
Configuration
The daemon reads config from ~/.config/choreographr/config.toml (all fields
optional):
= 0 # daemon-wide tool-loop budget; 0 = unlimited (default)
[]
= ["AGENTS.md", "CLAUDE.md"]
= 32768
= false
Note: Provider-level settings (
base_url,streaming,retry_*, timeouts, endpoint paths, request format, etc.) have moved to per-account overrides inaccounts.toml. They are no longer read fromconfig.toml.
Credentials are encrypted per-credential with the daemon's X25519 public key
and stored in the redb database. Identity keys reside in
~/.config/choreographr/identity.pk (private),
~/.config/choreographr/public.pk (public), and optionally
~/.config/choreographr/identity.pk.enc (passphrase-encrypted private key).
The socket path defaults to /tmp/Choreographr.sock (override with
CHOREOGRAPHR_SOCKET_PATH). The database path defaults to
~/.local/share/choreographr/state.redb (override with CHOREOGRAPHR_DB_PATH).
CHOREOGRAPHR_MAX_TURNS overrides the max_turns setting from config.toml
(resolution chain: CHOREOGRAPHR_MAX_TURNS → config.toml → default 0; 0 =
unlimited — the agent loop runs until the model produces a final answer, is
cancelled, or hits an error). This is a daemon-wide cap; individual sessions no
longer carry their own max_turns.
Accounts
Accounts are configured via ~/.config/choreographr/accounts.toml. Account
names must be lowercase alphanumeric with hyphens or underscores ([a-z0-9_-]).
Each session may have its own account, set via /account <name>; there is no
global default account.
[[]]
= "main"
= "openai"
[[]]
= "claude"
= "anthropic"
[[]]
= "gemini"
= "google"
[[]]
= "local"
= "ollama"
= "http://localhost:11434/v1"
= false
= 3
Supported providers: all entries in the provider catalog — 79+ across three
wire protocols (OpenAI-compatible, Anthropic Messages, Google Generative AI).
Each provider has its own data file under
choreo-ai-protocols/src/catalog/<slug>.toml (one file per provider,
TOML data, not code) with a curated model list, context windows, reasoning
levels, and the API format each model uses. Highlights: OpenAI, Anthropic,
Google Gemini, Mistral, DeepSeek, xAI Grok, Groq, Together AI, OpenRouter,
Hugging Face, GitHub Models, NVIDIA NIM, Cerebras, Fireworks AI, Alibaba
(Qwen), Moonshot AI (Kimi), Perplexity, Z.ai, Xiaomi MiMo, Qwen Token Plan, Vercel AI
Gateway, OpenCode Zen/Go, GitHub Copilot, Kimi Code, Ollama (local/cloud), LM
Studio, and many regional/niche gateways. See the catalog/ directory for the
full list. Each provider ships sensible defaults (base URL, default model) —
override any field per-account:
| Field | Description |
|---|---|
base_url |
API base URL |
streaming |
Enable/disable streaming responses |
stream_options |
Include usage in stream |
retry_max_attempts |
Max retry count on transient errors |
retry_initial_backoff_ms |
Initial backoff between retries (ms) |
retry_max_backoff_ms |
Max backoff between retries (ms) |
connect_timeout_secs |
TCP connect timeout |
request_timeout_secs |
HTTP request timeout |
total_timeout_secs |
Wall-clock deadline for a single request attempt including the streaming body (default 3600s; 0 disables). Complements request_timeout_secs (idle/no-progress): armed before the request is sent and re-armed on each retry, so one attempt's budget spans DNS → connect → headers → body (ureq's timeout_global bounds it from DNS through the first body byte, and the SSE consumer enforces the same deadline with an exact timer, so it fires even when keep-alive bytes trickle in). Expiry surfaces as a dedicated deadline_exceeded error. Each retry restarts the deadline, so retries + backoff can exceed it in aggregate. |
model_list_path |
Custom models list endpoint path |
responses_path |
Custom responses endpoint path |
chat_completions_path |
Custom chat completions endpoint path |
default_request_format |
Request format: "chat_completions" or "responses" |
chat_completions_max_tokens |
Default max tokens for chat completions |
model_max_tokens |
Per-model max token caps |
chat_completions_max_tokens_field |
Token field: "max_tokens" or "max_completion_tokens" |
model_max_tokens_fields |
Per-model token field overrides |
responses_max_output_tokens |
Default max output tokens for Responses API |
model_responses_max_output_tokens |
Per-model max output tokens for Responses API |
programmatic_tool_calling |
Enable programmatic tool calling (Responses API, gpt-5.6+) |
context_window |
Default context window for all models (overrides catalog defaults) |
model_context_windows |
Per-model context window overrides (e.g. {"gpt-4.1-nano": 1048576}) |
The Responses API is fully supported — including tool use, streaming, reasoning
effort slugs (mapped to the reasoning_effort wire field), multi-turn chaining
via previous_response_id, and programmatic tool calling (gpt-5.6+
models). With default_request_format = "responses", system messages go into
the input array and tool results into function_call_output input items.
Programmatic tool calling auto-enables for gpt-5.6 models using the Responses
API; set programmatic_tool_calling = true to override.
Sessions can be created and browsed while the daemon is locked — credentials are only required when running prompts.
Slash commands
In choreo-tui:
/ping— health check/models— list and select models/model— alias for/models/session— show current session info/session list— list all sessions/session new [title]— create a new session/session switch <id>— switch to a different session/session info <id>— show info for a specific session/cancel <request-id>— cancel a running request/unlock [passphrase]— unlock the daemon (readsidentity.pkor decryptsidentity.pk.enc)/lock— lock the daemon, clearing credentials from memory/add-key <service> <api_key> [unlock]— add an API key credential (service name must be[a-z0-9_-])/add-x <service> <api_key> <api_key_secret> <access_token> <access_token_secret> <bearer_or_->_ [unlock]— add an X credential (service name must be[a-z0-9_-])/remove-key <service>— remove a credential/account list— list configured AI provider accounts/account remove <name>— remove an AI provider account/account <name>— set the session's AI provider accountCtrl+A— open the AI provider accounts page (list accounts;Entersets the highlighted account on the active session and returns to chat,rremoves,csets an API key,nstarts the new-account wizard)- New-account wizard (
non the accounts page) — a two-phase flow: pick a provider (j/knavigate,PgUp/PgDnpage), then enter a slug (the account's unique name, e.g./account <slug>); Enter creates the account and jumps straight to the API-key page /reasoning— show current reasoning effort slug/reasoning <slug>— set reasoning effort (e.g.off,low,medium,high,on,xhigh,max; available values depend on the model)Ctrl+R— cycle reasoning effort through available slugs for the attached session's modelCtrl+M— open the model selector: list models available on the attached session's account, type to filter, Enter to select, Esc to dismiss (requires a terminal that implements the kitty keyboard protocol — e.g. kitty, foot, wezterm, ghostty, alacritty; on other terminals Ctrl+M arrives as Enter)/continue— continue a stopped/idle session by sending a "Please continue." prompt/stop— cancel whatever request is currently active on the attached session (same as/cancel 0)/undo— undo the most recent user turn and its entire assistant response subtree/redo— redo the most recently undone turn (cleared if new input is sent)- any other input — sent as a prompt
In choreo-tui, Ctrl+C exits the local client and disconnects from the
daemon without requesting daemon shutdown.
Security model
The daemon starts locked. Clients resolve the private key (reading
identity.pk directly, or decrypting identity.pk.enc with a passphrase) and
send it to the daemon via ClientMessage::Unlock. The daemon then decrypts all
stored credential blobs into memory.
- Credentials are encrypted per-credential with ECDH (X25519) + HKDF + AES-256-GCM; only the holder of the private key can decrypt them.
/lockdestroys all in-memory credentials and returns the daemon to the locked state.- The private key is zeroized after use; lock/unlock does not interrupt session browsing — credentials are only needed at prompt time.
- Remote connections (over TCP) use the Noise IK handshake with X25519 key
agreement, giving an authenticated, encrypted transport for clients like
choreo-gui(via--tcp-addr/--server-pk).
Monitoring
The daemon can expose an OpenMetrics (Prometheus) endpoint:
When --metrics-addr is provided, a dedicated HTTP thread serves GET /metrics
at the given address. Without the flag, no metrics server is started. Metrics
include session counts, connection counts, request latency, API call latency,
tool execution time, error breakdowns, and process-level metrics (RSS, CPU,
file descriptors).
Metrics are compiled in via the metrics cargo feature, which is
off by default. A plain build omits the Prometheus machinery entirely. To
enable the endpoint:
Release binaries enable metrics explicitly (alongside pdf) via
scripts/release.sh, so installed binaries keep the /metrics endpoint. When
a build was made without the feature, the --metrics-addr flag is still
accepted but the daemon refuses to start with a clear error telling you to
rebuild with --features metrics.
Testing & development
The workspace uses cargo-nextest as its primary test runner:
it executes every test in its own process, in parallel across all cores, and
gives per-test timeouts and retries. Install it once with
cargo install cargo-nextest (or brew install nextest on macOS); the aliases
below fail with "no such command" until it is on PATH. The unit-vs-integration
split is the same as libtest's — integration tests live in crate-level tests/
and are marked #[ignore] (see AGENTS.md):
cargo test-lean is the feature-off run: it compiles the workspace with every
optional feature disabled (metrics, pdf, mimalloc), which is the only way the
metrics no-op stub backend and the feature-off --metrics-addr startup refusal
in server/lifecycle.rs get built — the --all-features aliases never compile
that configuration, so test-lean guards against the stubs drifting out of
sync with the real backend.
The nextest profile lives in .config/nextest.toml: fail-fast = false (run
the whole suite even after a failure) and a 120s slow-timeout that aborts any
hung test. On a 16-core machine cargo test-all runs the entire suite (~2,050
tests, unit + integration) in ~6s wall, versus ~22s for the two equivalent
libtest commands (cargo test + cargo test -- --ignored) on a warm build.
Nextest wins on two fronts: it parallelizes across test binaries (libtest runs
them one at a time) and runs every test in its own process. Useful raw nextest
invocations:
Note that the test-* aliases bake in --workspace, so passing -p <crate>
to them is rejected by cargo (conflicting flags) — run
cargo nextest run -p <crate> directly to scope a run to a single crate.
justfile
A justfile wraps the common workflows above (and the daemon run
commands) in one place — just lists every recipe, and just help explains the
prerequisites. Install just with cargo install just (or brew install just
on macOS); the recipes require the same toolchain as the
Build from source section (cargo ≥ 1.91 + zig), and
nextest only where noted:
just --set profile debug build switches the build profile (default release);
CARGO_FLAGS (env) appends flags to every cargo invocation. The nextest-backed
recipes (test, test-fast, test-lean, test-integration, test-all,
test-crate, shard, retry) fail with an install hint until cargo-nextest
is on PATH.
Packaging & releases
Release tooling lives in scripts/ and the packaging assets it
consumes in packaging/ — see packaging/README.md for the
per-asset breakdown. The end-to-end runbook for cutting a release (crates.io
publish, both build machines, GitHub release, Homebrew/AUR/choreographr.com
updates) is RELEASE.md. The one-command flow is:
Equivalently, invoke the scripts directly:
Prebuilt installs (no Rust toolchain needed) use scripts/install.sh, which
pins the version and verifies a SHA-256 checksum before extracting the four
binaries (choreographr choreo-tui choreo-im choreo-acp — choreo-mcp is a
library-only crate and ships no binary). The systemd unit / launchd agent is
installed but never auto-enabled — the daemon is a user service and
starting it is an explicit choice (systemctl --user enable --now choreographr).
Troubleshooting
choreo-tuiwrites its diagnostics to/tmp/choreo-tui.log— check there for client-side issues.- The daemon logs to stderr; use
-v/-vvfor more detail, or setRUST_LOG.