Struct Token 

pub struct Token<'a> {
    pub kind: u16,
    pub start: usize,
    pub end: usize,
    pub value: Value<'a>,
}

One token.

Fields

kind: u16

The token number of the grammar. See crate::token and crate::character. The end of the text is 0.

start: usize

The byte offset where the token starts.

end: usize

The byte offset after the token.

value: Value<'a>

The value.

Implementations

impl Token<'_>

pub fn text(&self) -> Option<&str>

The text of the value, or None when the value is not text.

Trait Implementations

impl<'a> Clone for Token<'a>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Debug for Token<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'a> PartialEq for Token<'a>

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl<'a> StructuralPartialEq for Token<'a>