Struct OpenAiCompatibleProvider 

pub struct OpenAiCompatibleProvider { /* private fields */ }

Reference LlmProvider backed by an OpenAI-compatible HTTP endpoint.

Concretely this is what mailrs uses against its self-hosted qwen3.5-9b server — but any service that accepts the same POST {system, messages, temperature} shape works. The embedding endpoint is derived by substituting /complete → /embed in the URL.

Implementations

impl OpenAiCompatibleProvider

pub fn new(url: String, api_key: Option<String>, model_id: String) -> Self

Construct a provider pointing at the given completion URL.

model_id is what consumers persist alongside analysis results to detect when re-analysis is required (typical format: "qwen3.5-9b/v8").

pub fn with_client( url: String, api_key: Option<String>, model_id: String, client: Client, ) -> Self

Construct with a caller-supplied reqwest::Client (e.g. one with a shared connection pool, custom TLS config, or proxy settings).

Trait Implementations

impl Clone for OpenAiCompatibleProvider

fn clone(&self) -> OpenAiCompatibleProvider

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for OpenAiCompatibleProvider

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl LlmProvider for OpenAiCompatibleProvider

fn complete<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, system: &'life1 str, user_message: &'life2 str, temperature: f32, ) -> Pin<Box<dyn Future<Output = Option<String>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Run a chat completion against the model.

fn embed<'life0, 'life1, 'async_trait>( &'life0 self, text: &'life1 str, ) -> Pin<Box<dyn Future<Output = Option<Vec<f32>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Generate an embedding vector for text.

fn model_id(&self) -> &str

Stable identifier for the model + prompt revision in use.