Struct LocalLLMClient 

pub struct LocalLLMClient { /* private fields */ }

Client for OpenAI-compatible local LLM runtimes.

The struct mirrors the field layout of the hosted-provider clients (OpenAIClient, OpenRouterClient) but stores the API key as Option<String> because most local runtimes accept unauthenticated requests. The request_timeout_seconds value is retained so it can be embedded in timeout error messages.

Implementations

impl LocalLLMClient

pub fn new( api_key: Option<String>, model: String, temperature: f32, max_tokens: u32, retry_attempts: u32, retry_delay_ms: u64, base_url: String, request_timeout_seconds: u64, ) -> Self

Construct a new LocalLLMClient with explicit parameters.

pub fn from_config(config: &AIConfig) -> Result<Self>

Create a LocalLLMClient from the unified AIConfig.

Validates that base_url is non-empty, emits the shared insecure-HTTP warning (which already exempts loopback), and constructs an inner reqwest::Client honoring request_timeout_seconds.

pub async fn chat_completion(&self, messages: Vec<Value>) -> Result<String>

Issue a chat-completions request, applying retry + actionable error mapping. Sends only OpenAI-canonical body fields.

Trait Implementations

impl AIProvider for LocalLLMClient

fn analyze_content<'life0, 'async_trait>( &'life0 self, request: AnalysisRequest, ) -> Pin<Box<dyn Future<Output = Result<MatchResult>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Analyze multimedia files and subtitle files for matching results.

fn verify_match<'life0, 'async_trait>( &'life0 self, verification: VerificationRequest, ) -> Pin<Box<dyn Future<Output = Result<ConfidenceScore>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Verify file matching confidence.

fn chat_completion<'life0, 'async_trait>( &'life0 self, messages: Vec<Value>, ) -> Pin<Box<dyn Future<Output = Result<String>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Send a raw chat completion request to the provider.

impl Debug for LocalLLMClient

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl HttpRetryClient for LocalLLMClient

fn retry_attempts(&self) -> u32

Number of retry attempts.

fn retry_delay_ms(&self) -> u64

Delay between retries in milliseconds.

async fn make_request_with_retry( &self, request: RequestBuilder, ) -> Result<Response>

Make an HTTP request with retry logic.

impl PromptBuilder for LocalLLMClient

fn build_analysis_prompt(&self, request: &AnalysisRequest) -> String

Build analysis prompt.

fn build_verification_prompt(&self, request: &VerificationRequest) -> String

Build verification prompt.

fn get_analysis_system_message() -> &'static str

System message for analysis prompt.

fn get_verification_system_message() -> &'static str

System message for verification prompt.

impl ResponseParser for LocalLLMClient

fn parse_match_result(&self, response: &str) -> Result<MatchResult>

Parse match result.

fn parse_confidence_score(&self, response: &str) -> Result<ConfidenceScore>

Parse confidence score.