Enum Tok 

pub enum Tok {
    Ident(String),
    Keyword(&'static Word),
    Int(i64),
    Float(f64),
    Unit(String, String),
    Version(String),
    Str(Vec<StrPart>),
    RawStr(String),
    Char(char),
    Lifetime(String),
    Text(String),
    Content(String, String),
    Tag(String),
    Doc(String),
    Punct(Punct),
    Eof,
}

What a token is.

Variants

Ident(String)

Keyword(&'static Word)

A reserved word (words/).

Int(i64)

Float(f64)

Unit(String, String)

A number with a unit (20t, 3b, 100Energy): the number as written, the unit’s name.

Version(String)

A version (1.20.1), as written.

Str(Vec<StrPart>)

RawStr(String)

Char(char)

Lifetime(String)

'a: a lifetime, by its name.

Text(String)

A translatable text by key: t"charge.tooltip".

Content(String, String)

@kind:namespace:path: the kind, the id.

Tag(String)

#namespace:path.

Doc(String)

/// …: a declaration’s documentation line.

Punct(Punct)

Eof

Trait Implementations

impl Clone for Tok

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Tok

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Tok

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Tok