Struct RawToken

pub struct RawToken {
    pub kind: RawTokenKind,
    pub len: u32,
}

A raw token.

It doesn’t contain information about data that has been parsed, only the type of the token and its size.

Fields

kind: RawTokenKind

The kind of token.

len: u32

The length of the token in bytes.

Implementations

impl RawToken

pub const EOF: RawToken

The EOF token with length 0.

pub const fn new(kind: RawTokenKind, len: u32) -> RawToken

Creates a new token.

Trait Implementations

impl Clone for RawToken

fn clone(&self) -> RawToken

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RawToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl PartialEq for RawToken

fn eq(&self, other: &RawToken) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for RawToken

impl StructuralPartialEq for RawToken