Crate rustc_lexer

Source

Modules§

character_properties
unescape
Utilities for validating string and char literals and turning them into values they represent.

Structs§

Token

Enums§

Base
LiteralKind
TokenKind

Functions§

first_token
strip_shebang
tokenize