Struct Token

pub struct Token<'a> {
    pub token_type: TokenType<'a>,
    pub value: &'a str,
    pub tail: &'a str,
}

A token parsed from an expression

Fields

token_type: TokenType<'a>

The type of token

value: &'a str

The token’s value

tail: &'a str

The remaining text after this token

Implementations

impl<'a> Token<'a>

pub fn first(src: &'a str) -> Result<Option<Self>>

Parses the first token from a string

pub fn next(&self) -> Result<Option<Self>>

Parses the next token after this one

Trait Implementations

impl<'a> Clone for Token<'a>

fn clone(&self) -> Token<'a>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.