Struct AsyncLanguageModelAdapter 

pub struct AsyncLanguageModelAdapter { /* private fields */ }

Adapter to connect BoxedAsyncLanguageModel to LLMClient trait

Implementations

impl AsyncLanguageModelAdapter

pub fn new(model: Arc<BoxedAsyncLanguageModel>) -> Self

Creates a new adapter wrapping a BoxedAsyncLanguageModel.

Arguments

• model - The async language model to wrap in the adapter

Returns

A new AsyncLanguageModelAdapter instance

Trait Implementations

impl LLMClient for AsyncLanguageModelAdapter

fn generate_summary<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, text: &'life1 str, prompt: &'life2 str, _max_tokens: usize, _temperature: f32, ) -> Pin<Box<dyn Future<Output = Result<String>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Generate a summary for the given text

fn model_name(&self) -> &str

Get model name

fn generate_summary_batch<'life0, 'life1, 'life2, 'life3, 'async_trait>( &'life0 self, texts: &'life1 [(&'life2 str, &'life3 str)], max_tokens: usize, temperature: f32, ) -> Pin<Box<dyn Future<Output = Result<Vec<String>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait, 'life3: 'async_trait,

Generate summary in batch for multiple texts