Struct Token 

pub struct Token<'a> {
    pub kind: TokenKind,
    pub begin: usize,
    pub end: usize,
    pub text: &'a [u8],
}

A token of the input: its kind and the byte range it covers.

Fields

kind: TokenKind

The token’s kind.

begin: usize

Byte offset into the input where the token starts.

end: usize

Byte offset into the input where the token ends (exclusive).

text: &'a [u8]

The bytes of the input the token covers.

Implementations

impl<'a> Token<'a>

pub fn text_str(&self) -> Result<&'a str, Utf8Error>

The token text as a string slice, if it is valid UTF-8.

Trait Implementations

impl<'a> Clone for Token<'a>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Copy for Token<'a>

impl<'a> Debug for Token<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'a> Eq for Token<'a>

impl<'a> PartialEq for Token<'a>

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl<'a> StructuralPartialEq for Token<'a>