Struct Token 

pub struct Token<'a> {
    pub kind: TokenKind,
    pub line: usize,
    pub column: usize,
    pub text: Cow<'a, str>,
    pub start: usize,
    pub end: usize,
    pub source: &'a str,
}

A single token produced by the Lexer.

Each token carries its line and column number for error reporting and its byte span inside the original source.

Fields

kind: TokenKind

line: usize

column: usize

text: Cow<'a, str>

start: usize

end: usize

source: &'a str

Implementations

impl<'a> Token<'a>

pub fn new( kind: TokenKind, line: usize, column: usize, text: impl Into<Cow<'a, str>>, start: usize, end: usize, source: &'a str, ) -> Self

Trait Implementations

impl<'a> Clone for Token<'a>

fn clone(&self) -> Token<'a>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Debug for Token<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'a> Eq for Token<'a>

impl<'a> PartialEq for Token<'a>

fn eq(&self, other: &Token<'a>) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl<'a> StructuralPartialEq for Token<'a>