Struct Token 

pub struct Token {
    pub kind: TokenKind,
    pub span: Span,
    pub raw: String,
    pub leading_whitespace: String,
}

A token with its position in the source.

Fields

kind: TokenKind

The kind and optional payload of this token.

span: Span

Source span of the token (excluding leading whitespace).

raw: String

Original source text of the token (e.g. "hello" including quotes).

leading_whitespace: String

Whitespace characters that appeared before this token on the same line.

Trait Implementations

impl Clone for Token

fn clone(&self) -> Token

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.