Struct Client 

pub struct Client { /* private fields */ }

Unified LLM client that works with both OpenAI and Anthropic APIs.

Implementations

impl Client

pub fn openai(api_key: impl Into<String>) -> Self

Create a client for the OpenAI API (https://api.openai.com/v1).

pub fn openai_with_base_url( api_key: impl Into<String>, base_url: impl Into<String>, ) -> Self

Create a client for an OpenAI-compatible API with a custom base URL.

pub fn anthropic(api_key: impl Into<String>) -> Self

Create a client for the Anthropic API (https://api.anthropic.com).

pub fn anthropic_with_base_url( api_key: impl Into<String>, base_url: impl Into<String>, ) -> Self

Create a client for an Anthropic-compatible API with a custom base URL.

pub fn from_provider(config: &LlmProviderConfig) -> Self

Create a client from a LlmProviderConfig.

pub async fn chat(&self, request: ChatRequest) -> Result<ChatResponse, Error>

Send a chat completion request and wait for the full response.

pub async fn chat_stream( &self, request: ChatRequest, ) -> Result<Pin<Box<dyn Stream<Item = Result<StreamEvent, Error>> + Send>>, Error>

Send a chat completion request and receive a stream of incremental events.