Function dedup 

pub fn dedup(texts: &[String]) -> Deduped

run the first-seen dedup pass over texts (the decompressed canonical strings, in chunk order). deterministic: a HashMap keyed by the text only decides membership, while first-seen ORDER is driven by the input sequence, so two builds over the same corpus match exactly.