Struct OpenAiCompatible 

pub struct OpenAiCompatible { /* private fields */ }

Any OpenAI-compatible chat endpoint: OpenAI itself, Ollama, vLLM, …

Implementations

impl OpenAiCompatible

pub fn new(base_url: &str, model: &str, api_key: Option<String>) -> Self

pub fn with_timeout(self, timeout: Duration) -> Self

pub fn with_think(self, think: bool) -> Self

Control thinking on reasoning models (Ollama passes think through; real OpenAI endpoints reject unknown fields, so the field is only serialized when explicitly set).

Trait Implementations

impl LlmProvider for OpenAiCompatible

fn id(&self) -> &str

fn extract_facts(&self, text: &str) -> Result<Vec<ExtractedFact>>

fn answer_with_system( &self, system: &str, question: &str, context: &str, ) -> Result<String>

Answer with an explicit system prompt.

fn answer(&self, question: &str, context: &str) -> Result<String>

Answer with the default (v1) system prompt.