pub fn first_token(input: &str) -> Result<Token, SyntaxError>Expand description
Reads only the first non-comment token for explicit statement-family dispatch. The rest of the input is validated by the selected parser. The full-input byte limit applies to complete tokenization, not to statement dispatch.