Enum Token

pub enum Token<'a> {
    Comment(&'a str),
    Whitespace(&'a str),
    Break(&'a str),
    Symbol(&'a str),
    Literal(&'a str),
    Operator(&'a str),
    Unknown(&'a str),
    Column(&'a str),
}

Syntax-highlightable ExprTK tokens.

We had the option of implemnting this alternatively as pub struct Token(TokenType, &'a str);, but I felt this was less ergonomic for the frequent pattern matching necessary when handling enum tokens.

Variants

Comment(&'a str)

Whitespace(&'a str)

Break(&'a str)

Symbol(&'a str)

Literal(&'a str)

Operator(&'a str)

Unknown(&'a str)

Column(&'a str)

Implementations

impl<'a> Token<'a>

pub const fn content(&self) -> &'a str

Note the use of the lifetime 'a - this function does not work correctly when it’s signature is specified -> &'_ str instead, as self and the str may have different lifetimes.

Trait Implementations

impl<'a> Clone for Token<'a>

fn clone(&self) -> Token<'a>

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Debug for Token<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'a> PartialEq for Token<'a>

fn eq(&self, other: &Token<'a>) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl<'a> ToHtml for Token<'a>

fn to_html(&self) -> Html

Converts this type to a Html.

fn into_html(self) -> VNode

where Self: Sized,

Converts this type into a Html.

impl<'a> Copy for Token<'a>

impl<'a> Eq for Token<'a>

impl<'a> StructuralPartialEq for Token<'a>