Struct OpenAiProvider 

pub struct OpenAiProvider { /* private fields */ }

OpenAI provider (GPT-4o, o1, embeddings).

Implementations

impl OpenAiProvider

pub fn new(api_key: impl Into<String>) -> OpenAiProvider

Construct with an explicit API key.

pub fn from_env() -> Result<OpenAiProvider, LlmError>

Construct from the OPENAI_API_KEY environment variable.

pub fn model(self, model: impl Into<String>) -> OpenAiProvider

Set the default chat model.

pub fn embed_model(self, model: impl Into<String>) -> OpenAiProvider

Set the default embedding model.

pub fn base_url(self, base_url: impl Into<String>) -> OpenAiProvider

Override the base URL (e.g. for an OpenAI-compatible gateway).

pub fn with_client(self, client: Client) -> OpenAiProvider

Provide a custom reqwest::Client (connection pooling, timeouts, …).

Trait Implementations

impl Clone for OpenAiProvider

fn clone(&self) -> OpenAiProvider

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl LlmProvider for OpenAiProvider

fn chat<'life0, 'async_trait>( &'life0 self, req: ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatResponse, LlmError>> + Send + 'async_trait>>

where 'life0: 'async_trait, OpenAiProvider: 'async_trait,

Single-shot chat completion.

fn chat_stream<'life0, 'async_trait>( &'life0 self, req: ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<StreamDelta, LlmError>> + Send>>, LlmError>> + Send + 'async_trait>>

where 'life0: 'async_trait, OpenAiProvider: 'async_trait,

Streaming chat completion.

fn embed<'life0, 'async_trait>( &'life0 self, req: EmbedRequest, ) -> Pin<Box<dyn Future<Output = Result<EmbedResponse, LlmError>> + Send + 'async_trait>>

where 'life0: 'async_trait, OpenAiProvider: 'async_trait,

Generate embeddings.

fn name(&self) -> &'static str

Provider name (“openai” | “anthropic” | “ollama”).

fn model(&self) -> &str

Active default model slug.

fn estimate_cost(&self, req: &ChatRequest) -> Option<CostEstimate>

Pre-flight cost estimate (no network call). None if unknown.