pub fn tokenize(text: &str) -> Vec<String>
Keep document token frequencies; query callers can deduplicate separately.