Enum any_lexer::PythonToken

pub enum PythonToken {
    Space,
    LineComment,
    ExplicitLineJoiner,
    Ident,
    Keyword,
    SoftKeyword,
    ShortString,
    LongString,
    ShortBytes,
    LongBytes,
    Int,
    Float,
    Delim,
    Punct,
    Unknown,
}

Variants

Space

LineComment

ExplicitLineJoiner

Ident

Keyword

SoftKeyword

ShortString

LongString

ShortBytes

LongBytes

Int

Float

Delim

Punct

Unknown

Given valid Python code, then this variant should never be encountered. If is is encountered, then check if an issue has already been submitted, otherwise please submit an issue.

Trait Implementations

impl Clone for PythonToken

fn clone(&self) -> PythonToken

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PythonToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq<PythonToken> for PythonToken

fn eq(&self, other: &PythonToken) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl ScanToken for PythonToken

fn scan_token<'text>( scanner: &mut Scanner<'text> ) -> Option<(Self, TokenSpan<'text>)>

impl Copy for PythonToken

impl Eq for PythonToken

impl StructuralEq for PythonToken

impl StructuralPartialEq for PythonToken