Skip to main content

TokenRole

Enum TokenRole 

Source
#[non_exhaustive]
pub enum TokenRole {
Show 19 variants Name, Var { sigil: u8, }, Label { sigil: u8, }, Lifetime { sigil: u8, }, Int, Float, Number, Str(Escapes), RawStr, Heredoc(Escapes), StrPart(Escapes), Char(Escapes), Bytes(Escapes), True, False, Null, Wild, Rest, Type(TypeName),
}
Expand description

What a token means when it is lowered on its own.

§Examples

use lower_lang::{Escapes, TokenRole};

let var = TokenRole::Var { sigil: 1 };       // `$name`, name `name`
let string = TokenRole::Str(Escapes::Standard);
assert_ne!(var, string);

Variants (Non-exhaustive)§

This enum is marked as non-exhaustive
Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.
§

Name

An identifier: a name, a variable reference, a binding, or a type name.

§

Var

A sigiled variable such as $x; the first sigil bytes are not part of the name.

Fields

§sigil: u8

Bytes to strip.

§

Label

A loop label such as 'outer.

Fields

§sigil: u8

Bytes to strip.

§

Lifetime

A region (lifetime) such as 'a, as a generic parameter or argument.

Fields

§sigil: u8

Bytes to strip.

§

Int

An integer literal (0x, 0o, 0b prefixes and _ separators accepted; a registered suffix sets its type).

§

Float

A floating-point literal.

§

Number

A number: a float if it has a fraction or an exponent, else an integer.

§

Str(Escapes)

A string literal, quotes included in the token.

§

RawStr

A raw string literal, taken verbatim: optional ASCII prefix letters (r, R, br), optional # fences, then one quote character (", ', or `), or a tripled one (""", Python), closed by the same quote(s) and the same number of #s. Rust r#"a "b""#, Python r'\d+'. Malformed fences are an InvalidLiteral.

§

Heredoc(Escapes)

A PHP heredoc (Standard escapes) or nowdoc (None) as one token: <<<ID (or <<<"ID", <<<'ID'), a newline, the body lines, and the closing identifier on its own line. Per PHP 7.3+, the whitespace before the closing identifier is removed from every body line (a line indented less, or tabs mixed with spaces, is an InvalidLiteral), and the newline before the closing identifier is not part of the string. A heredoc with interpolation is an Interp node instead.

§

StrPart(Escapes)

A literal piece of an interpolated string: the text between embedded expressions, without quotes; escapes decoded.

§

Char(Escapes)

A character literal, quotes included.

§

Bytes(Escapes)

A byte-string literal, quotes (and a leading b) included.

§

True

true.

§

False

false.

§

Null

null / nil / None-as-keyword.

§

Wild

_: a wildcard pattern, or an inferred type.

§

Rest

.. inside a pattern.

§

Type(TypeName)

A type keyword (int, mixed, Self, !).

Trait Implementations§

Source§

impl Clone for TokenRole

Source§

fn clone(&self) -> Self

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Copy for TokenRole

Source§

impl Debug for TokenRole

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Eq for TokenRole

Source§

impl Hash for TokenRole

Source§

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher. Read more
1.3.0 · Source§

fn hash_slice<H>(data: &[Self], state: &mut H)
where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher. Read more
Source§

impl PartialEq for TokenRole

Source§

fn eq(&self, other: &Self) -> bool

Equality operator ==. Read more
1.0.0 (const: unstable) · Source§

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=. Read more
Source§

impl StructuralPartialEq for TokenRole

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.