rucora Providers

rucora 的 LLM Provider 实现。

概述

本 crate 包含 rucora 的各种 LLM Provider 具体实现，用于与不同的大语言模型服务交互。

支持的 Provider

安装

[dependencies]
rucora-providers = "0.1"

或通过主 rucora crate：

[dependencies]
rucora = { version = "0.1", features = ["providers"] }

使用方式

OpenAI Provider

use rucora_providers::OpenAiProvider;
use rucora_core::provider::LlmProvider;

let provider = OpenAiProvider::from_env()?;

let request = ChatRequest::from_user_text("你好");
let response = provider.chat(request).await?;
println!("{}", response.message.content);

Anthropic Provider

use rucora_providers::AnthropicProvider;

let provider = AnthropicProvider::from_env()?
    .with_default_model("claude-3-5-sonnet-20241022");

Gemini Provider

use rucora_providers::GeminiProvider;

let provider = GeminiProvider::from_env()?
    .with_default_model("gemini-1.5-pro");

Resilient Provider（带重试）

use rucora_providers::{OpenAiProvider, ResilientProvider, RetryConfig};
use std::sync::Arc;

let inner = Arc::new(OpenAiProvider::from_env()?);
let provider = ResilientProvider::new(inner)
    .with_config(RetryConfig::new()
        .with_max_retries(3)
        .with_base_delay_ms(200));

Feature 配置

环境变量

许可证

MIT