aonyx-llm
Multi-provider LLM router. One LlmProvider trait,
several implementations, one configurable fallback chain.
Providers
- [
anthropic] — native Anthropic Messages API (streaming SSE). - [
openai_compat] — shared OpenAI-compatible backend.- [
openai] — public OpenAI API (https://api.openai.com). - [
openrouter] — OpenRouter aggregator, with optional attribution headers. - [
lm_studio] — local OpenAI-compatible LM Studio server.
- [
- [
ollama] — local Ollama (/api/chat), JSON-lines streaming. - [
claude_code] — wraps the installedclaudebinary; no API key required (auth delegated to Claude Code subscription / its env vars). - [
nous_portal] — Nous Portal endpoint (deferred).
Router
[Router] holds an ordered list of providers and forwards each request to
the first one whose stream opens successfully.