Struct OpenAI 

pub struct OpenAI {
    pub client: Client,
    /* private fields */
}

An OpenAI-compatible LLM provider.

Fields

client: Client

The HTTP client.

Implementations

impl OpenAI

pub fn custom( client: Client, key: &str, endpoint: &str, model: &str, ) -> Result<Self>

Create a provider targeting a custom OpenAI-compatible endpoint with Bearer auth.

pub fn no_auth(client: Client, endpoint: &str, model: &str) -> Self

Create a provider targeting a custom endpoint without authentication (e.g. Ollama).

Trait Implementations

impl Clone for OpenAI

fn clone(&self) -> OpenAI

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Model for OpenAI

async fn send(&self, request: &Request) -> Result<Response>

Send a chat completion request.

fn stream( &self, request: Request, ) -> impl Stream<Item = Result<StreamChunk>> + Send

Stream a chat completion response.

fn active_model(&self) -> CompactString

Get the active/default model name.

fn context_limit(&self, model: &str) -> usize

Resolve the context limit for a model name.