Function ilc::dedup

pub fn dedup(
    ctx: &Context, 
    input: &mut BufRead, 
    decoder: &mut Decode, 
    output: &mut Write, 
    encoder: &Encode
) -> Result<(), Error>

Deduplicate subsequent identical elements, e.g. after a sorting operation. This will not read all events into memory, and only operate on a short window of events. Therefore, it'll only work correctly on sorted or very short logs.