pub fn preprocess_text_with_filename(text: &str, filename: &str) -> Vec<String>Expand description
Preprocesses text with filename for search by tokenizing and removing duplicates This is used for filename matching - it adds the filename and its directory structure to the tokens