Struct ValidatedLLM

pub struct ValidatedLLM { /* private fields */ }

A wrapper around an LLM provider that validates responses before returning them.

The wrapper implements validation by:

1. Sending the request to the underlying provider
2. Validating the response using the provided validator function
3. If validation fails, retrying with feedback up to the configured number of attempts

Type Parameters

The wrapped provider must implement the LLMProvider trait.

Implementations

impl ValidatedLLM

pub fn new( inner: Box<dyn LLMProvider>, validator: Box<dyn Fn(&str) -> Result<(), String> + Sync + Send>, attempts: usize, ) -> ValidatedLLM

Creates a new ValidatedLLM wrapper around an existing LLM provider.

Arguments

• inner - The LLM provider to wrap with validation
• validator - Function that takes a response string and returns Ok(()) if valid, or Err with error message if invalid
• attempts - Maximum number of validation attempts before failing

Returns

A new ValidatedLLM instance configured with the provided parameters.

Trait Implementations

impl ChatProvider for ValidatedLLM

fn chat_with_tools<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, messages: &'life1 [ChatMessage], tools: Option<&'life2 [Tool]>, ) -> Pin<Box<dyn Future<Output = Result<Box<dyn ChatResponse>, LLMError>> + Send + 'async_trait>>

where 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait, ValidatedLLM: 'async_trait,

Sends a chat request and validates the response.

If validation fails, retries with feedback to the model about the validation error. The feedback is appended as a new user message to help guide the model.

Arguments

• messages - The chat messages to send to the model

Returns

• Ok(String) - The validated response from the model
• Err(LLMError) - If validation fails after max attempts or other errors occur

fn chat<'life0, 'life1, 'async_trait>( &'life0 self, messages: &'life1 [ChatMessage], ) -> Pin<Box<dyn Future<Output = Result<Box<dyn ChatResponse>, LLMError>> + Send + 'async_trait>>

where 'life0: 'async_trait, 'life1: 'async_trait, Self: 'async_trait,

Sends a chat request to the provider with a sequence of messages.

impl CompletionProvider for ValidatedLLM

fn complete<'life0, 'life1, 'async_trait>( &'life0 self, req: &'life1 CompletionRequest, ) -> Pin<Box<dyn Future<Output = Result<CompletionResponse, LLMError>> + Send + 'async_trait>>

where 'life0: 'async_trait, 'life1: 'async_trait, ValidatedLLM: 'async_trait,

Sends a completion request and validates the response.

If validation fails, retries up to the configured number of attempts. Unlike chat, completion requests don’t support adding feedback messages.

Arguments

• req - The completion request to send

Returns

• Ok(CompletionResponse) - The validated completion response
• Err(LLMError) - If validation fails after max attempts or other errors occur

impl EmbeddingProvider for ValidatedLLM

fn embed<'life0, 'async_trait>( &'life0 self, input: Vec<String>, ) -> Pin<Box<dyn Future<Output = Result<Vec<Vec<f32>>, LLMError>> + Send + 'async_trait>>

where 'life0: 'async_trait, ValidatedLLM: 'async_trait,

Passes through embedding requests to the inner provider without validation.

Embeddings are numerical vectors that represent text semantically and don’t require validation since they’re not human-readable content.

Arguments

• input - Vector of strings to generate embeddings for

Returns

• Ok(Vec<Vec<f32>>) - Vector of embedding vectors
• Err(LLMError) - If the embedding generation fails

impl LLMProvider for ValidatedLLM

fn tools(&self) -> Option<&[Tool]>

impl SpeechToTextProvider for ValidatedLLM

fn transcribe<'life0, 'async_trait>( &'life0 self, _audio: Vec<u8>, ) -> Pin<Box<dyn Future<Output = Result<String, LLMError>> + Send + 'async_trait>>

where 'life0: 'async_trait, ValidatedLLM: 'async_trait,

Transcribe the given audio bytes into text

fn transcribe_file<'life0, 'life1, 'async_trait>( &'life0 self, file_path: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<String, LLMError>> + Send + 'async_trait>>

where 'life0: 'async_trait, 'life1: 'async_trait, Self: 'async_trait,