Struct OpenAiCompatibleClient 

pub struct OpenAiCompatibleClient { /* private fields */ }

Client for the OpenAI chat-completions protocol.

Also serves every OpenAI-compatible endpoint (Ollama, vLLM, LM Studio, a compatible proxy) — point base_url at it and keep the protocol.

Implementations

impl OpenAiCompatibleClient

pub fn new( base_url: impl Into<String>, model: impl Into<String>, api_key: impl Into<String>, ) -> Result<Self, AgentError>

Build a client. The key never leaves this struct except as a header.

Errors

Returns AgentError when the underlying HTTP client cannot be built.

pub fn with_timeout(self, timeout: Duration) -> Result<Self, AgentError>

Replace the request timeout.

Errors

Returns AgentError when the underlying HTTP client cannot be rebuilt.

pub fn chat_url(&self) -> String

Chat endpoint URL.

Trait Implementations

impl Debug for OpenAiCompatibleClient

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl LlmClient for OpenAiCompatibleClient

fn chat<'a>( &'a self, request: &'a ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatResponse, AgentError>> + Send + 'a>>

Send one chat request and decode the response.

fn list_models( &self, ) -> Pin<Box<dyn Future<Output = Result<Vec<String>, AgentError>> + Send + '_>>

List available model ids. Cheap and read-only: the health check uses it.

fn provider_name(&self) -> &'static str

Human-readable provider name for logs and health details.