Module rustpython_parser::lexer

This module takes care of lexing python source text. This means source code is translated into separate tokens.

Re-exports

pub use super::token::Tok;

Structs

Lexer
LexicalError
LineContinationHandler
Location
NewlineHandler

Enums

LexicalErrorType

Functions

get_keywords
make_tokenizer

Type Definitions

LexResult
Spanned