pub type Token = <u16 as NonZeroT>::Type;Expand description
A token of the grammar.
Also called a terminal in some literature.
A token is a single ‘word’ in the text. For example, in the following Rust code:
let x: i32 = 1 + 2;The list of tokens (excluding whitespace) would be
["let", "x", ":", "i32", "=", "1", "+", "2", ";"].