Struct OpenAI 

pub struct OpenAI {
    pub client: Client,
    /* private fields */
}

An OpenAI-compatible LLM provider.

Fields

client: Client

The HTTP client.

Implementations

impl OpenAI

pub fn api(client: Client, key: &str) -> Result<Self>

Create a provider targeting the OpenAI API.

pub fn grok(client: Client, key: &str) -> Result<Self>

Create a provider targeting the Grok (xAI) API.

pub fn qwen(client: Client, key: &str) -> Result<Self>

Create a provider targeting the Qwen (DashScope) API.

pub fn kimi(client: Client, key: &str) -> Result<Self>

Create a provider targeting the Kimi (Moonshot) API.

pub fn ollama(client: Client) -> Result<Self>

Create a provider targeting a local Ollama instance (no API key).

pub fn custom(client: Client, key: &str, endpoint: &str) -> Result<Self>

Create a provider targeting a custom OpenAI-compatible endpoint.

Trait Implementations

impl Clone for OpenAI

fn clone(&self) -> OpenAI

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Model for OpenAI

async fn send(&self, request: &Request) -> Result<Response>

Send a chat completion request.

fn stream( &self, request: Request, ) -> impl Stream<Item = Result<StreamChunk>> + Send

Stream a chat completion response.

fn active_model(&self) -> CompactString

Get the active/default model name.

fn context_limit(&self, model: &str) -> usize

Resolve the context limit for a model name.