pub enum TokenType {
Show 69 variants
ENDMARKER,
NAME,
INTEGER,
BININT,
OCTINT,
HEXINT,
FLOAT,
IMAGINARY,
NUMBER,
STRING,
NEWLINE,
INDENT,
DEDENT,
LPAR,
RPAR,
LSQB,
RSQB,
COLON,
COMMA,
SEMI,
PLUS,
MINUS,
STAR,
SLASH,
VBAR,
AMPER,
LESS,
GREATER,
EQUAL,
DOT,
PERCENT,
LBRACE,
RBRACE,
EQEQUAL,
NOTEQUAL,
LESSEQUAL,
GREATEREQUAL,
TILDE,
CIRCUMFLEX,
LEFTSHIFT,
RIGHTSHIFT,
DOUBLESTAR,
PLUSEQUAL,
MINEQUAL,
STAREQUAL,
SLASHEQUAL,
PERCENTEQUAL,
AMPEREQUAL,
VBAREQUAL,
CIRCUMFLEXEQUAL,
LEFTSHIFTEQUAL,
RIGHTSHIFTEQUAL,
DOUBLESTAREQUAL,
DOUBLESLASH,
DOUBLESLASHEQUAL,
AT,
ATEQUAL,
RARROW,
ELLIPSIS,
COLONEQUAL,
OP,
AWAIT,
ASYNC,
TYPE_IGNORE,
TYPE_COMMENT,
ERRORTOKEN,
COMMENT,
NL,
ENCODING,
}Variants§
ENDMARKER
NAME
INTEGER
BININT
OCTINT
HEXINT
FLOAT
IMAGINARY
NUMBER
STRING
NEWLINE
INDENT
DEDENT
LPAR
RPAR
LSQB
RSQB
COLON
COMMA
SEMI
PLUS
MINUS
STAR
SLASH
VBAR
AMPER
LESS
GREATER
EQUAL
DOT
PERCENT
LBRACE
RBRACE
EQEQUAL
NOTEQUAL
LESSEQUAL
GREATEREQUAL
TILDE
CIRCUMFLEX
LEFTSHIFT
RIGHTSHIFT
DOUBLESTAR
PLUSEQUAL
MINEQUAL
STAREQUAL
SLASHEQUAL
PERCENTEQUAL
AMPEREQUAL
VBAREQUAL
CIRCUMFLEXEQUAL
LEFTSHIFTEQUAL
RIGHTSHIFTEQUAL
DOUBLESTAREQUAL
DOUBLESLASH
DOUBLESLASHEQUAL
AT
ATEQUAL
RARROW
ELLIPSIS
COLONEQUAL
OP
AWAIT
ASYNC
TYPE_IGNORE
TYPE_COMMENT
ERRORTOKEN
COMMENT
NL
ENCODING
Trait Implementations§
impl Copy for TokenType
impl Eq for TokenType
impl StructuralPartialEq for TokenType
Auto Trait Implementations§
impl Freeze for TokenType
impl RefUnwindSafe for TokenType
impl Send for TokenType
impl Sync for TokenType
impl Unpin for TokenType
impl UnwindSafe for TokenType
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more