Enum rustc_ap_rustc_lexer::TokenKind [−][src]
pub enum TokenKind {}Show variants
LineComment { doc_style: Option<DocStyle>, }, BlockComment { doc_style: Option<DocStyle>, terminated: bool, }, Whitespace, Ident, RawIdent, Literal { kind: LiteralKind, suffix_start: usize, }, Lifetime { starts_with_number: bool, }, Semi, Comma, Dot, OpenParen, CloseParen, OpenBrace, CloseBrace, OpenBracket, CloseBracket, At, Pound, Tilde, Question, Colon, Dollar, Eq, Bang, Lt, Gt, Minus, And, Or, Plus, Star, Slash, Caret, Percent, Unknown,
Expand description
Enum representing common lexeme types.
Variants
“// comment”
/* block comment */
Block comments can be recursive, so the sequence like /* /* */
will not be considered terminated and will result in a parsing error.
Any whitespace characters sequence.
“ident” or “continue” At this step keywords are also considered identifiers.
“r#ident”
“12_u8”, “1.0e-40”, “b“123”“. See LiteralKind
for more details.
Show fields
Fields of Literal
kind: LiteralKind
suffix_start: usize
“’a”
Show fields
Fields of Lifetime
starts_with_number: bool
“;”
“,”
“.”
“(”
“)”
“{”
“}”
“[”
“]”
“@”
“#”
“~”
“?”
“:”
“$”
“=”
“!”
“<”
“>”
“-”
“&”
“|”
“+”
“*”
“/”
“^”
“%”
Unknown token, not expected by the lexer, e.g. “№”
Trait Implementations
This method returns an ordering between self
and other
values if one exists. Read more
This method tests less than (for self
and other
) and is used by the <
operator. Read more
This method tests less than or equal to (for self
and other
) and is used by the <=
operator. Read more
This method tests greater than (for self
and other
) and is used by the >
operator. Read more
Auto Trait Implementations
impl RefUnwindSafe for TokenKind
impl UnwindSafe for TokenKind
Blanket Implementations
Mutably borrows from an owned value. Read more