pub fn tokenize_query(q: &str) -> Vec<String>Expand description
Tokenize a free-text query the same way the columnar writer tokenizes stored text (lowercase, split on non-alphanumeric, drop tokens < 2 chars), so query tokens line up with the per-extent token index used for pruning.