Struct Token 

pub struct Token {
    pub kind: TokenType,
    pub span: Span,
}

A lexical token, identifying its kind and span.

We define our own Token as the json_tools::Token defines a Buffer that can be heap allocated or a Span. We only use the Span variant.

Our Token can also impl Copy and Clone as the size and semantics are acceptable.

Fields

kind: TokenType

The exact type of the token

span: Span

The span allows to reference back into the source byte stream to obtain the string making up the token. Please note that for control characters, booleans and null (i.e

Trait Implementations

impl Clone for Token

fn clone(&self) -> Token

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Ord for Token

fn cmp(&self, other: &Token) -> Ordering

This method returns an Ordering between self and other.

fn max(self, other: Self) -> Self

where Self: Sized,

Compares and returns the maximum of two values.

fn min(self, other: Self) -> Self

where Self: Sized,

Compares and returns the minimum of two values.

fn clamp(self, min: Self, max: Self) -> Self

where Self: Sized,

Restrict a value to a certain interval.

impl PartialEq for Token

fn eq(&self, other: &Token) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl PartialOrd for Token

fn partial_cmp(&self, other: &Token) -> Option<Ordering>

This method returns an ordering between self and other values if one exists.

fn lt(&self, other: &Rhs) -> bool

Tests less than (for self and other) and is used by the < operator.

fn le(&self, other: &Rhs) -> bool

Tests less than or equal to (for self and other) and is used by the <= operator.

fn gt(&self, other: &Rhs) -> bool

Tests greater than (for self and other) and is used by the > operator.

fn ge(&self, other: &Rhs) -> bool

Tests greater than or equal to (for self and other) and is used by the >= operator.

impl TryFrom<&Token> for Token

type Error = PartialError

The type returned in the event of a conversion error.

fn try_from(token: &Token) -> Result<Self, Self::Error>

Performs the conversion.

impl TryFrom<Token> for Token

type Error = PartialError

The type returned in the event of a conversion error.

fn try_from(token: Token) -> Result<Self, Self::Error>

Performs the conversion.

impl Copy for Token

impl Eq for Token

impl StructuralPartialEq for Token