LLM provider trait, streaming primitives, and first-party provider implementations.
This crate defines the [LlmProvider] trait that all LLM backends implement,
streaming types for incremental response processing, attachment validation,
model capability metadata, and seven first-party provider implementations.
Provider Implementations
| Provider | Module | Protocol |
|---|---|---|
| Anthropic (Messages API) | [impls::anthropic] |
SSE streaming |
| OpenAI (Chat Completions) | [impls::openai] |
SSE streaming |
| OpenAI (Responses API) | [impls::openai_responses] |
SSE streaming |
| OpenAI Codex / ChatGPT | [impls::openai_codex_responses] |
WebSocket |
| Google Gemini | [impls::gemini] |
SSE streaming |
| Google Vertex AI | [impls::vertex] |
SSE streaming |
| Cloudflare AI Gateway | [impls::cloudflare_ai_gateway] |
Proxy wrapper |