pub fn tokenize_for_dialect(input: &str, dialect: Dialect) -> Lexed<'_>Expand description
Tokenize input for dialect, using that dialect’s default lexing rules.
The dialect drives quoting and special-token behavior ($$/$n dollar handling, @stage
references); see Dialect.