Function tokenize_file 

pub fn tokenize_file(path: &Path, source: &str) -> FileTokens

Tokenize a source file into a sequence of normalized tokens.

For Vue/Svelte SFC files, extracts <script> blocks first and tokenizes their content, mirroring the main analysis pipeline’s SFC handling.