Struct EventDeduplicator 

pub struct EventDeduplicator<T> { /* private fields */ }

High-level event deduplicator

Provides a type-safe interface for event deduplication with configurable ID extraction strategies and comprehensive error handling.

Implementations

impl<T> EventDeduplicator<T>

pub async fn new( config: DeduplicationConfig, extractor: EventIdExtractor<T>, ) -> StateResult<Self>

Create a new event deduplicator

Arguments

• config - Deduplication configuration
• extractor - Event ID extraction strategy

Returns

A new EventDeduplicator instance

Errors

Returns error if Redis connection fails

pub async fn is_duplicate(&self, event: &T) -> StateResult<bool>

Check if an event is a duplicate

Arguments

• event - The event to check

Returns

true if the event is a duplicate, false otherwise

Errors

Returns error if Redis operation fails

pub async fn mark_seen(&self, event: &T) -> StateResult<()>

Mark an event as seen

Arguments

• event - The event to mark as seen

Errors

Returns error if Redis operation fails

pub async fn check_and_mark(&self, event: &T) -> StateResult<bool>

Check and mark event as seen in one operation (optimized)

Arguments

• event - The event to check and mark

Returns

true if the event was a duplicate, false if it was new

Errors

Returns error if Redis operation fails

pub async fn batch_check_duplicates( &self, events: &[T], ) -> StateResult<Vec<bool>>

Batch check multiple events for duplicates

Arguments

• events - Slice of events to check

Returns

Vector of booleans indicating which events are duplicates

Errors

Returns error if Redis operation fails

pub async fn batch_mark_seen(&self, events: &[&T]) -> StateResult<()>

Batch mark multiple events as seen

Arguments

• events - Slice of events to mark as seen

Errors

Returns error if Redis operation fails

pub async fn stats(&self) -> DeduplicationStats

Get deduplication statistics

pub async fn health_check(&self) -> StateResult<bool>

Check backend health

pub async fn clear(&self) -> StateResult<usize>

Clear all deduplication data (use with caution!)

This removes all deduplication state. Only use for testing or maintenance.

Trait Implementations

impl<T> Clone for EventDeduplicator<T>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<T> Debug for EventDeduplicator<T>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.