Struct OpenAiCompatibleDriver 

pub struct OpenAiCompatibleDriver { /* private fields */ }

Driver for OpenAI-compatible chat completions APIs.

Works with OpenAI, Groq, DeepSeek, Together, Fireworks, Cerebras, xAI, Mistral, and any other provider exposing the /v1/chat/completions endpoint.

Implementations

impl OpenAiCompatibleDriver

pub fn new(api_key: String, base_url: String, provider_name: String) -> Self

Create a new OpenAI-compatible driver.

pub fn with_client( client: Client, api_key: String, base_url: String, provider_name: String, ) -> Self

Create a new OpenAI-compatible driver with a shared HTTP client.

pub fn build_request_body(&self, request: &CompletionRequest) -> Value

Build the OpenAI chat completions request body.

pub fn parse_response(&self, body: &Value) -> PunchResult<CompletionResponse>

Parse the OpenAI chat completions response.

impl OpenAiCompatibleDriver

pub fn parse_openai_stream( &self, raw: &str, callback: &StreamCallback, ) -> PunchResult<CompletionResponse>

Parse an OpenAI-style SSE stream into a CompletionResponse, invoking the callback for each chunk.

Trait Implementations

impl LlmDriver for OpenAiCompatibleDriver

fn complete<'life0, 'async_trait>( &'life0 self, request: CompletionRequest, ) -> Pin<Box<dyn Future<Output = PunchResult<CompletionResponse>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Send a completion request and return the response.

fn stream_complete_with_callback<'life0, 'async_trait>( &'life0 self, request: CompletionRequest, callback: StreamCallback, ) -> Pin<Box<dyn Future<Output = PunchResult<CompletionResponse>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Streaming completion with per-chunk callback. Returns the final assembled CompletionResponse.

fn stream_complete<'life0, 'async_trait>( &'life0 self, request: CompletionRequest, ) -> Pin<Box<dyn Future<Output = PunchResult<CompletionResponse>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Streaming variant. Default implementation falls back to complete.