Struct OpenAiCompatibleConfig 

pub struct OpenAiCompatibleConfig {
    pub base_url: String,
    pub api_key: Option<String>,
    pub default_model: String,
    pub provider_name: String,
    pub display_name: String,
    pub capabilities: LlmCapabilities,
    pub timeout: Duration,
}

Configuration for the OpenAI-compatible provider

Fields

base_url: String

Base URL for the API (e.g., http://localhost:11434/v1)

api_key: Option<String>

API key (optional for local servers). Redacted in Debug.

default_model: String

Default model to use

provider_name: String

Provider name for logging; decides what name() reports

display_name: String

Provider display name

capabilities: LlmCapabilities

Capabilities of this provider; they decide which optional request fields reach the wire

timeout: Duration

HTTP request timeout for a client the provider builds itself

Implementations

impl OpenAiCompatibleConfig

pub fn ollama(model: &str) -> Self

Create configuration for a local Ollama instance

pub fn vllm(model: &str) -> Self

Create configuration for a local vLLM instance

pub fn local_ai(model: &str) -> Self

Create configuration for LocalAI

pub fn from_env() -> Self

Read the configuration from the environment; the endpoint’s port decides the provider name (11434 Ollama, 8000 vLLM, 8080 LocalAI, anything else local).

pub fn openai_api(model: &str) -> Self

Create configuration for the OpenAI API at https://api.openai.com/v1, reporting openai_api.

Any endpoint that speaks the same API under its own /v1 works by replacing base_url.

pub fn openai_api_from_env() -> Self

Read the OpenAI API configuration from the environment.

OPENAI_API_BASE_URL (default https://api.openai.com) names the host without the version path: requests go to its /v1. An unset OPENAI_API_MODEL is gpt-5.4, an unset or unparseable OPENAI_API_TIMEOUT_SECS is 120, and an unset or empty OPENAI_API_KEY sends no Authorization header.

Trait Implementations

impl Clone for OpenAiCompatibleConfig

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for OpenAiCompatibleConfig

fn fmt(&self, f: &mut Formatter<'_>) -> FmtResult

Formats the value using the given formatter.

impl Default for OpenAiCompatibleConfig

fn default() -> Self

Returns the “default value” for a type.