Struct Token 

pub struct Token<'a> {
    pub sym: Sym<'a>,
    pub line: u32,
    pub col: u32,
}

A token with position information.

Tokens are the output of lexical analysis and the input to syntactic analysis. Each token contains a symbol (its type and value) along with its position in the source code.

Fields

sym: Sym<'a>

The symbol (type and value) of this token

line: u32

Line number where this token appears (1-indexed)

col: u32

Column number where this token appears (1-indexed)

Trait Implementations

impl<'a> Clone for Token<'a>

fn clone(&self) -> Token<'a>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Debug for Token<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<Token<'_>> for Pos

fn from(value: Token<'_>) -> Self

Converts to this type from the input type.

impl<'a> From<Token<'a>> for Attrs

fn from(value: Token<'a>) -> Self

Converts to this type from the input type.

impl<'a> Serialize for Token<'a>

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl<'a> Copy for Token<'a>