Struct Token 

pub struct Token {
    pub kind: TokenKind,
    pub range: SourceRange,
    pub origin: Origin,
}

A preprocessed C token: what the parser consumes.

Deliberately shaped like lex::Token minus the flags the preprocessor needed and plus the Origin it produced, so that the parser’s view of a token did not have to change.

Fields

kind: TokenKind

What the token is.

range: SourceRange

Where to blame: the token’s own range, or the range of the macro invocation it came out of.

origin: Origin

How the token got here.

Implementations

impl Token

pub fn keyword(&self) -> Option<Keyword>

The keyword this token is, if any.

pub fn is_punct(&self, p: Punct) -> bool

Whether this token is the given punctuator.

pub fn is_keyword(&self, k: Keyword) -> bool

Whether this token is the given keyword.

pub fn is_eof(&self) -> bool

Whether this token ends the input.

pub fn ident(&self) -> Option<&str>

The identifier this token is, if any.

Trait Implementations

impl Clone for Token

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Token

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Token