LLM provider implementations for Converge.

This crate provides concrete LLM provider implementations that connect to actual API services. The core LlmProvider trait is defined in converge-core; this crate provides the implementations.

Available Providers

[AnthropicProvider] - Claude API (Anthropic)
[OpenAiProvider] - GPT-4, GPT-3.5 (OpenAI)
[GeminiProvider] - Gemini Pro (Google)
[PerplexityProvider] - Perplexity AI
[QwenProvider] - Qwen models (Alibaba Cloud)
[OpenRouterProvider] - Multi-provider aggregator
[MinMaxProvider] - MinMax AI
[GrokProvider] - Grok (xAI)
[MistralProvider] - Mistral AI
[DeepSeekProvider] - DeepSeek AI
[BaiduProvider] - Baidu ERNIE
[ZhipuProvider] - Zhipu GLM
[KimiProvider] - Kimi (Moonshot AI)
[ApertusProvider] - Apertus (Switzerland, EU digital sovereignty)

Prompt Structuring

This crate provides provider-specific prompt structuring and optimization:

[ProviderPromptBuilder]: Builds prompts optimized for specific providers
[StructuredResponseParser]: Parses structured responses (XML/JSON)
Helper functions: [build_claude_prompt], [build_openai_prompt]

Examples

Using Anthropic (Claude)

use converge_provider::{AnthropicProvider, build_claude_prompt, StructuredResponseParser};
use converge_core::llm::{LlmProvider, LlmRequest};
use converge_core::prompt::{AgentRole, OutputContract, PromptContext};
use converge_core::context::ContextKey;

let provider = AnthropicProvider::from_env("claude-3-5-sonnet-20241022")?;

// Build optimized prompt with XML structure
let prompt = build_claude_prompt(
    AgentRole::Proposer,
    "extract-competitors",
    PromptContext::new(),
    OutputContract::new("proposed-fact", ContextKey::Competitors),
    vec![],
);

let response = provider.complete(&LlmRequest::new(prompt))?;

// Parse structured XML response
let proposals = StructuredResponseParser::parse_claude_xml(
    &response,
    ContextKey::Competitors,
    "anthropic",
);

Using `OpenAI`

use converge_provider::OpenAiProvider;
use converge_core::llm::{LlmProvider, LlmRequest};

let provider = OpenAiProvider::from_env("gpt-4")?;
let response = provider.complete(&LlmRequest::new("Hello!"))?;

Using `OpenRouter` (Multi-Provider)

use converge_provider::OpenRouterProvider;
use converge_core::llm::{LlmProvider, LlmRequest};

// Access any provider through OpenRouter
let provider = OpenRouterProvider::from_env("anthropic/claude-3-opus")?;
let response = provider.complete(&LlmRequest::new("Hello!"))?;

converge-provider 0.2.0