Crate a2a_llm 

Provider-neutral vocabulary for chat completions, plus the providers that speak it.

LlmProvider is the port: chat_completion and chat_completion_stream over LlmRequest / LlmResponse. openai covers OpenAI and every OpenAI-compatible endpoint (OpenRouter, vLLM, llama.cpp); gemini covers Google’s API. provider_from_env picks one from the environment.

The types are deliberately not tied to A2A. ToolCall and ToolDefinition are the tool-calling vocabulary shared with the MCP bridge, which is why they live in their own crate rather than inside an agent framework.

Re-exports

pub use provider::LlmConfigError;

pub use provider::LlmSettings;

pub use provider::PROVIDER_ENV_VARS;

pub use provider::ReasoningPlan;

pub use provider::SUPPORTED_PROVIDERS;

pub use provider::SelectedLlm;

pub use provider::provider_from_env;

pub use provider::provider_from_settings;

pub use tool_call::PartialToolCall;

pub use tool_call::ToolCallAccumulator;

Modules

gemini

openai

provider

Centralized LlmProvider selection.

tool_call

Incremental tool-call assembly for streaming LLM responses.

Structs

ChatMessage

A single message in a chat conversation.

LlmRequest

A request to an LLM provider for chat completion.

LlmResponse

A response from an LLM provider.

TokenUsage

Tokens a provider reported for one request.

ToolCall

Represents a specific tool invocation requested by the LLM.

ToolDefinition

Defines a tool (function) available for the LLM to call.

Enums

FinishReason

Why the model stopped generating, normalized across providers.

LlmError

Represents an error returned by an LLM provider.

LlmStreamEvent

An event emitted during a streaming LLM response.

MessageRole

The role of the message sender.

Reasoning

What to ask a reasoning-capable model to do with its thinking.

ReasoningEffort

How hard a reasoning model should think, when reasoning is requested.

Traits

LlmProvider

Trait defining a generic LLM provider for standardizing AI integration across agents.