Struct Token

pub struct Token<'src> {
    pub tag: TokenTag<'src>,
    pub line: usize,
    pub col: usize,
    pub len: usize,
}

A token with respect to it’s location in the token stream

Fields

tag: TokenTag<'src>

The tag

line: usize

Line

col: usize

Column in line

len: usize

Length of token

Trait Implementations

impl<'src> Clone for Token<'src>

fn clone(&self) -> Token<'src>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'src> Debug for Token<'src>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'src> PartialEq for Token<'src>

fn eq(&self, other: &Token<'src>) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl<'src> Copy for Token<'src>

impl<'src> StructuralPartialEq for Token<'src>