Struct Token

pub struct Token {
    pub type: Type,
    pub lexeme: String,
    pub literal: Option<Literal>,
    pub location: Location,
}

Represents a token in the language.

Fields

type: Type

Type of the token.

lexeme: String

String representation of the token.

literal: Option<Literal>

Literal value of the token (if any).

location: Location

Location of the token in the source code.

Implementations

impl Token

pub fn new( type: Type, lexeme: String, literal: Option<Literal>, location: Location, ) -> Token

Creates a new token.

Trait Implementations

impl Clone for Token

fn clone(&self) -> Token

Returns a duplicate of the value.

const fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<&str> for Token

Convenience methods for creating dummy tokens.

fn from(token: &str) -> Self

Converts to this type from the input type.

impl Hash for Token

This is required for the HashMap to work for Interpreter::locals. Since no two tokens can have the same type, lexeme, and location, we can use them as the key for the HashMap.

fn hash<H: Hasher>(&self, state: &mut H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for Token

fn eq(&self, other: &Token) -> bool

Tests for self and other values to be equal, and is used by ==.

const fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for Token

impl StructuralPartialEq for Token