Module syntex_syntax::tokenstream

Token Trees

TokenTrees are syntactic forms for dealing with tokens. The description below is more complete; in short a TokenTree is a single token, a delimited sequence of token trees, or a sequence with repetition for list splicing as part of macro expansion.

Structs

Delimited	A delimited sequence of token trees
SequenceRepetition	A sequence of token trees

Enums

KleeneOp	A Kleene-style repetition operator for token sequences.
TokenTree	When the main rust parser encounters a syntax-extension invocation, it parses the arguments to the invocation as a token-tree. This is a very loose structure, such that all sorts of different AST-fragments can be passed to syntax extensions using a uniform type.