pub struct LlmEventSummarizer { /* private fields */ }Expand description
An LLM-based event summarizer for sliding window compaction.
When called with a list of events, this formats the events, generates a
summary using an LLM, and returns a new Event containing the summary
within an EventCompaction.
Implementations§
Trait Implementations§
Source§impl BaseEventsSummarizer for LlmEventSummarizer
impl BaseEventsSummarizer for LlmEventSummarizer
Source§fn summarize_events<'life0, 'life1, 'async_trait>(
&'life0 self,
events: &'life1 [Event],
) -> Pin<Box<dyn Future<Output = Result<Option<Event>>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
fn summarize_events<'life0, 'life1, 'async_trait>(
&'life0 self,
events: &'life1 [Event],
) -> Pin<Box<dyn Future<Output = Result<Option<Event>>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
Summarize the given events into a single compacted event.
Returns
None if no compaction is needed (e.g., empty input).Auto Trait Implementations§
impl Freeze for LlmEventSummarizer
impl !RefUnwindSafe for LlmEventSummarizer
impl Send for LlmEventSummarizer
impl Sync for LlmEventSummarizer
impl Unpin for LlmEventSummarizer
impl UnsafeUnpin for LlmEventSummarizer
impl !UnwindSafe for LlmEventSummarizer
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> FutureExt for T
impl<T> FutureExt for T
Source§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
Source§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request