Struct OpenAiCompatibleClient 

pub struct OpenAiCompatibleClient { /* private fields */ }

OpenAI-compatible client for self-hosted servers.

Implementations

impl OpenAiCompatibleClient

pub fn new( mode: OpenAiCompatibleMode, remote_model: String, base_url: String, bearer_token: Option<String>, supports_temperature: bool, supports_thinking: bool, supports_reasoning: bool, ) -> OpenAiCompatibleClient

Trait Implementations

impl LlmClient for OpenAiCompatibleClient

fn stream<'a>( &'a self, request: &'a LlmRequest, ) -> Pin<Box<dyn Stream<Item = Result<LlmEvent, LlmError>> + Send + 'a>>

Stream a completion request

fn provider(&self) -> &'static str

Get the provider name (for logging/debugging)

fn health_check<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = Result<(), LlmError>> + Send + 'async_trait>>

where 'life0: 'async_trait, OpenAiCompatibleClient: 'async_trait,

Check if the client is healthy/connected

fn compile_schema( &self, output_schema: &OutputSchema, ) -> Result<CompiledSchema, SchemaError>

Compile an output schema for this provider.