a2a-llm

Provider-neutral vocabulary for chat completions, plus the providers that speak it.

[dependencies]
a2a-llm = "0.1"

What it is

LlmProvider is the port — chat_completion and chat_completion_stream over LlmRequest / LlmResponse:

• openai covers OpenAI and every OpenAI-compatible endpoint (OpenRouter, vLLM, llama.cpp).
• gemini covers Google's API.
• provider_from_env picks one from the environment; provider_from_settings picks one from config a host already parsed.

SUPPORTED_PROVIDERS is ["openrouter", "openai", "gemini"], and PROVIDER_ENV_VARS is the selection order — public so a host can print it in a diagnostic instead of keeping its own copy that drifts.

use a2a_llm::{LlmProvider, LlmRequest, ChatMessage, provider_from_env};

# async fn run() -> Result<(), Box<dyn std::error::Error>> {
let selected = provider_from_env()?.expect("no provider key in the environment");
let response = selected
    .provider
    .chat_completion(LlmRequest::new(vec![ChatMessage::user("hello")]))
    .await?;
# Ok(())
# }

Why it is its own crate

The types are deliberately not tied to A2A. ToolCall and ToolDefinition are the tool-calling vocabulary shared with the MCP bridge, and a2a-mcp needed exactly those two out of what used to be a 5.3k-line agent-framework crate. Splitting them out means the bridge does not depend on an agent framework to name a tool call.

It is also the reason this half is MIT and commodity: LLM provider plumbing is not where the value is.

Selection is I/O-free, and says what it dropped

provider_from_env and provider_from_settings perform no network calls, so a pre-flight check can run the same code that startup will run and report the same answer. The one thing they report is a reasoning setting the chosen provider cannot put on the wire: SelectedLlm carries a ReasoningPlan, and ReasoningPlan::Unsupported names the drop rather than letting it be discovered on the bill. reasoning reaches the wire on openrouter today.

A variable set to whitespace reads as unset — .env files leave those behind, and an empty OPENROUTER_API_KEY would otherwise select a provider that cannot authenticate.

License

MIT. See LICENSE.