Struct Token 

pub struct Token {
    pub kind: TokenType,
    pub span: Span,
}

A lexical token, identifying its kind and span.

We define our own Token as the json_tools::Token defines a Buffer that can be heap allocated or a Span. We only use the Span variant.

Our Token can also impl Copy and Clone as the size and semantics are acceptable.

Fields

kind: TokenType

The exact type of the token.

span: Span

The span allows the caller to reference back into the source byte stream to obtain the string making up the token.

Trait Implementations

impl Clone for Token

fn clone(&self) -> Token

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Ord for Token

fn cmp(&self, other: &Token) -> Ordering

This method returns an Ordering between self and other.

fn max(self, other: Self) -> Self

where Self: Sized,

Compares and returns the maximum of two values.

fn min(self, other: Self) -> Self

where Self: Sized,

Compares and returns the minimum of two values.

fn clamp(self, min: Self, max: Self) -> Self

where Self: Sized,

Restrict a value to a certain interval.

impl PartialEq for Token

fn eq(&self, other: &Token) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl PartialOrd for Token

fn partial_cmp(&self, other: &Token) -> Option<Ordering>

This method returns an ordering between self and other values if one exists.

fn lt(&self, other: &Rhs) -> bool

Tests less than (for self and other) and is used by the < operator.

fn le(&self, other: &Rhs) -> bool

Tests less than or equal to (for self and other) and is used by the <= operator.

fn gt(&self, other: &Rhs) -> bool

Tests greater than (for self and other) and is used by the > operator.

fn ge(&self, other: &Rhs) -> bool

Tests greater than or equal to (for self and other) and is used by the >= operator.

impl TryFrom<&Token> for Token

type Error = PartialError

The type returned in the event of a conversion error.

fn try_from(token: &Token) -> Result<Self, Self::Error>

Performs the conversion.

impl TryFrom<Token> for Token

type Error = PartialError

The type returned in the event of a conversion error.

fn try_from(token: Token) -> Result<Self, Self::Error>

Performs the conversion.

impl Copy for Token

impl Eq for Token

impl StructuralPartialEq for Token