pub fn lex(source: &str) -> LexOutputExpand description
Lex source into tokens and lexical errors only.
Skips trivia allocation and blank-line processing. Use lex_with_trivia
when callers also need comments and trivia for lossless rendering.
pub fn lex(source: &str) -> LexOutputLex source into tokens and lexical errors only.
Skips trivia allocation and blank-line processing. Use lex_with_trivia
when callers also need comments and trivia for lossless rendering.