Struct Token

pub struct Token<K> { /* private fields */ }

A token with a kind (usually an enum representing distinct token types) and its source text

Implementations

impl<K> Token<K>

pub fn new(kind: K, text: String) -> Token<K>

Create a new token with the given kind and text

pub fn kind(&self) -> &K

Return the token’s kind (usually an enum)

pub fn text(&self) -> &String

Return the token’s text

pub fn into_text(self) -> String

Trait Implementations

impl<K: Debug> Debug for Token<K>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.