Struct TokenImpl 

pub struct TokenImpl<T>
where
    T: TokenType,
{
    pub token_type: T,
    pub value: String,
    pub pos: (usize, usize),
}

Generic Token implementation

A Token is anything that contains a type, a value, and a position in the input text

Fields

token_type: T

Token type

value: String

Token value

pos: (usize, usize)

Token absolute position in the input text (start, end) - start is inclusive, end is exclusive

Implementations

impl<T> TokenImpl<T>

where T: TokenType,

pub fn into<TO>(self) -> TokenImpl<TO>

where TO: From<T> + TokenType,

Convert to another token type, with the value and position untouched

pub fn to_html_text(&self) -> String

Convert the token to a raw html-escaped text without applying any style.

pub fn to_html(&self) -> String

Convert the token to an html string with class attributes provided by the token type (may be None)

This may return a <span> tag, or a raw string if the class name is None.

Trait Implementations

impl<T> Clone for TokenImpl<T>

where T: TokenType + Clone,

fn clone(&self) -> TokenImpl<T>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<T> Debug for TokenImpl<T>

where T: TokenType + Debug,

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<T> Default for TokenImpl<T>

where T: TokenType + Default,

fn default() -> TokenImpl<T>

Returns the “default value” for a type.

impl<T> PartialEq for TokenImpl<T>

where T: TokenType + PartialEq,

fn eq(&self, other: &TokenImpl<T>) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl<T> StructuralPartialEq for TokenImpl<T>

where T: TokenType,