rolter

High-performance OpenAI/Anthropic-compatible LLM gateway and load balancer.

rolter is the unified command-line launcher for the rolter system. A single binary dispatches to both planes:

# data-plane gateway (openai/anthropic-compatible proxy + load balancer)
rolter gateway --config rolter.toml

# control plane (management api + static dashboard host)
rolter control --database-url postgres://localhost/rolter

Install from crates.io:

cargo install rolter

or as a Python-managed CLI (maturin wheel):

uv tool install rolter

See the project README for architecture, configuration and deployment docs.

License

Apache-2.0