Struct OpenAiProvider 

pub struct OpenAiProvider { /* private fields */ }

OpenAI-compatible provider (works with OpenAI, OpenRouter, etc.)

Implementations

impl OpenAiProvider

pub fn new( base_url: &str, api_key: Option<&str>, model: &str, temperature: f64, max_tokens: Option<i32>, ) -> Result<Self, LlmError>

Create a new OpenAI-compatible provider.

pub fn openai(api_key: &str, model: &str) -> Self

Create for OpenAI API.

pub fn openrouter(api_key: &str, model: &str) -> Self

Create for OpenRouter.

Trait Implementations

impl LlmProvider for OpenAiProvider

fn generate<'life0, 'life1, 'async_trait>( &'life0 self, messages: &'life1 [Message], ) -> Pin<Box<dyn Future<Output = Result<Response, LlmError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Generate a complete response (non-streaming).

fn generate_stream<'life0, 'life1, 'async_trait>( &'life0 self, messages: &'life1 [Message], ) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<ResponseChunk, LlmError>> + Send>>, LlmError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Generate a streaming response.

fn health_check<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = bool> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Check if the provider is available.

fn name(&self) -> &str

Get the provider name.