aonyx-llm 0.10.0

Aonyx Agent — multi-provider LLM router (Anthropic, OpenAI, OpenRouter, Ollama, LM Studio, Nous Portal)
Documentation

aonyx-llm

Multi-provider LLM router. One LlmProvider trait, several implementations, one configurable fallback chain.

Providers

  • [anthropic] — native Anthropic Messages API (streaming SSE).
  • [openai_compat] — shared OpenAI-compatible backend.
    • [openai] — public OpenAI API (https://api.openai.com).
    • [openrouter] — OpenRouter aggregator, with optional attribution headers.
    • [lm_studio] — local OpenAI-compatible LM Studio server.
  • [ollama] — local Ollama (/api/chat), JSON-lines streaming.
  • [claude_code] — wraps the installed claude binary; no API key required (auth delegated to Claude Code subscription / its env vars).
  • [nous_portal] — Nous Portal endpoint (deferred).

Router

[Router] holds an ordered list of providers and forwards each request to the first one whose stream opens successfully.