Module ilc_ops::dedup

Event deduplication

Functions

dedup

Deduplicate subsequent identical elements, e.g. after a sorting operation. This will not read all events into memory, and only operate on a short window of events. Therefore, it'll only work correctly on sorted or very short logs.