crabllm

High-performance LLM API gateway in Rust.

Crabllm exposes an OpenAI-compatible API and routes requests to the configured provider — OpenAI, Anthropic, Google Gemini, Azure, AWS Bedrock, Ollama, and any OpenAI-compatible service.

Install

cargo install crabllm

Usage

crabllm --config crabllm.toml

See the docs for configuration, providers, routing, and extensions.

License

MIT OR Apache-2.0