Module syntex_syntax::parse::token [] [src]

Reexports

pub use self::BinOpToken::*;
pub use self::Nonterminal::*;
pub use self::DelimToken::*;
pub use self::Lit::*;
pub use self::Token::*;

Modules

keywords

Structs

InternedString

Represents a string stored in the thread-local interner. Because the interner lives for the life of the thread, this can be safely treated as an immortal string, as long as it never crosses between threads.

Enums

BinOpToken
DelimToken

A delimiter token

Lit
Nonterminal

For interpolation during macro expansion.

Token

Functions

clear_ident_interner
fresh_name
gensym

gensym's a new usize, using the current interner.

gensym_ident

Maps a string to a gensym'ed identifier.

intern

Maps a string to its interned representation.

intern_and_get_ident

Interns and returns the string contents of an identifier, using the thread-local interner.

reset_ident_interner

Reset the ident interner to its initial state.

str_to_ident

Maps a string to an identifier with an empty syntax context.

with_ident_interner

Type Definitions

IdentInterner