pub fn tokenize_with_limits( source: &str, limits: Limits, ) -> Result<Vec<Token>, Diagnostic>
Tokenizes with explicit resource limits.