pub fn run_prepass(
tokens: &[RawToken],
src: &str,
) -> (Vec<RawToken>, Vec<IndentDiagnostic>)Expand description
Inject Newline/Indent/Dedent markers into the lexer token stream.
Returns the augmented token stream plus any indentation diagnostics. The output is still lossless: the injected markers are zero-width, and every input token is preserved in order.