Struct RawToken 

pub struct RawToken {
    pub kind: String,
    pub text: String,
    pub start: usize,
    pub end: usize,
    pub line: usize,
    pub col: usize,
}

A simple tokenisation result with raw text.

Fields

kind: String

Kind string

text: String

Raw text of the token

start: usize

Start byte offset

end: usize

End byte offset

line: usize

Line number

col: usize

Column number

Trait Implementations

impl Clone for RawToken

fn clone(&self) -> RawToken

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RawToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.