Enum PythonToken

pub enum PythonToken {
    Space,
    LineComment,
    ExplicitLineJoiner,
    Ident,
    Keyword,
    SoftKeyword,
    ShortString,
    LongString,
    ShortBytes,
    LongBytes,
    Int,
    Float,
    Delim,
    Punct,
    Unknown,
}

Variants

Space

LineComment

ExplicitLineJoiner

Ident

Keyword

SoftKeyword

ShortString

LongString

ShortBytes

LongBytes

Int

Float

Delim

Punct

Unknown

Given valid Python code, then this variant should never be encountered. If is is encountered, then check if an issue has already been submitted, otherwise please submit an issue.

Trait Implementations

impl Clone for PythonToken

fn clone(&self) -> PythonToken

Returns a duplicate of the value.

const fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PythonToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for PythonToken

fn eq(&self, other: &PythonToken) -> bool

Tests for self and other values to be equal, and is used by ==.

const fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl ScanToken for PythonToken

fn scan_token<'text>( scanner: &mut Scanner<'text>, ) -> Option<(Self, TokenSpan<'text>)>

impl Copy for PythonToken

impl Eq for PythonToken

impl StructuralPartialEq for PythonToken