Struct ModelCompactor 

pub struct ModelCompactor { /* private fields */ }

Default Compactor that asks the same model for a structured summary through a durable provider attempt.

Implementations

impl ModelCompactor

pub fn new(model: Arc<dyn ChatModel>) -> Self

Compactor over model.

Trait Implementations

impl Compactor for ModelCompactor

fn name(&self) -> &str

Stable name recorded in compaction events.

fn summarize<'life0, 'life1, 'life2, 'life3, 'async_trait>( &'life0 self, model: &'life1 str, messages: &'life2 [ChatMessage], operation_id: &'life3 str, cancellation: CancellationToken, deadline: Instant, ) -> Pin<Box<dyn Future<Output = Result<CompactionResult, RuntimeError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait, 'life3: 'async_trait,

Summarize transcript, returning the summary and the usage it cost.