Enum Token

pub enum Token {
    Any,
    ArrayBuffer,
    Attribute,
    Boolean,
    Byte,
    ByteString,
    Callback,
    Const,
    DataView,
    Deleter,
    Dictionary,
    DOMString,
    Double,
    Enum,
    Error,
    False,
    Float,
    Float32Array,
    Float64Array,
    FrozenArray,
    Getter,
    Implements,
    Includes,
    Inherit,
    Int16Array,
    Int32Array,
    Int8Array,
    Interface,
    Iterable,
    LegacyCaller,
    Long,
    Maplike,
    Mixin,
    Namespace,
    NaN,
    NegativeInfinity,
    Null,
    Object,
    Octet,
    Optional,
    Or,
    Partial,
    PositiveInfinity,
    Promise,
    ReadOnly,
    Record,
    Required,
    Sequence,
    Setlike,
    Setter,
    Short,
    Static,
    Stringifier,
    Symbol,
    True,
    Typedef,
    USVString,
    Uint16Array,
    Uint32Array,
    Uint8Array,
    Uint8ClampedArray,
    Unrestricted,
    Unsigned,
    Void,
    FloatLiteral(f64),
    Identifier(String),
    OtherLiteral(char),
    SignedIntegerLiteral(i64),
    StringLiteral(String),
    UnsignedIntegerLiteral(u64),
    Colon,
    Comma,
    Ellipsis,
    Equals,
    GreaterThan,
    Hyphen,
    LeftBrace,
    LeftBracket,
    LeftParenthesis,
    LessThan,
    Period,
    QuestionMark,
    RightBrace,
    RightBracket,
    RightParenthesis,
    Semicolon,
}

An enum of all possible tokens allowed by the WebIDL grammar A token in this case is a terminal, either a static string or regular expression based token. Note that not all possible simplifications are made such as converting the True and False tokens to actual booleans. This choice was made to be as consistent as possible with the WebIDL grammar.

Variants

Any

ArrayBuffer

Attribute

Boolean

Byte

ByteString

Callback

Const

DataView

Deleter

Dictionary

DOMString

Double

Enum

Error

False

Float

Float32Array

Float64Array

FrozenArray

Getter

Implements

Includes

Inherit

Int16Array

Int32Array

Int8Array

Interface

Iterable

LegacyCaller

Long

Maplike

Mixin

Namespace

NaN

NegativeInfinity

Null

Object

Octet

Optional

Or

Partial

PositiveInfinity

Promise

ReadOnly

Record

Required

Sequence

Setlike

Setter

Short

Static

Stringifier

Symbol

True

Typedef

USVString

Uint16Array

Uint32Array

Uint8Array

Uint8ClampedArray

Unrestricted

Unsigned

Void

FloatLiteral(f64)

Identifier(String)

OtherLiteral(char)

SignedIntegerLiteral(i64)

StringLiteral(String)

UnsignedIntegerLiteral(u64)

Colon

Comma

Ellipsis

Equals

GreaterThan

Hyphen

LeftBrace

LeftBracket

LeftParenthesis

LessThan

Period

QuestionMark

RightBrace

RightBracket

RightParenthesis

Semicolon

Trait Implementations

impl Clone for Token

fn clone(&self) -> Token

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Token

fn eq(&self, other: &Token) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for Token