Struct PpToken 

pub struct PpToken {
    pub kind: PpTokenKind,
    pub flags: TokenFlags,
    pub value: Option<Symbol>,
    pub span: Span,
}

One preprocessing token.

Sixteen bytes, which spec/05-preprocessor.md section 5.2 asks for, and there is a test below that says so. The size is not vanity: a large translation unit is tens of millions of these and they are walked repeatedly by the macro expander.

Fields

kind: PpTokenKind

The category.

flags: TokenFlags

Facts about the token that its bytes do not carry.

value: Option<Symbol>

The spelling, interned, for the categories that have one. None for punctuators, whose spelling is recoverable from the kind, and for end of file.

span: Span

Where the token sits in the source, in real file bytes.

Implementations

impl PpToken

pub const fn is_eof(self) -> bool

Whether this is the end of file marker.

pub const fn punct(self) -> Option<Punct>

The punctuator, when this is one.

Trait Implementations

impl Clone for PpToken

fn clone(&self) -> PpToken

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for PpToken

impl Debug for PpToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for PpToken

impl PartialEq for PpToken

fn eq(&self, other: &PpToken) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for PpToken