Trait ToTokens 

pub trait ToTokens {
    // Required method
    fn to_tokens(&self, tokens: &mut TokenStream);

    // Provided methods
    fn to_token_iter(&self) -> TokenIter { ... }
    fn into_token_iter(self) -> TokenIter
       where Self: Sized { ... }
    fn to_token_stream(&self) -> TokenStream { ... }
    fn into_token_stream(self) -> TokenStream
       where Self: Sized { ... }
    fn tokens_to_string(&self) -> String { ... }
}

unsynn defines its own ToTokens trait to be able to implement it for std container types. This is similar to the ToTokens from the quote crate but adds some extra methods and is implemented for more types. Moreover the to_token_iter() method is the main entry point for crating an iterator that can be used for parsing.

Using with the unsynn! macro

The [unsynn!] macro provides convenient syntax sugar for customizing token emission via the to_tokens clause. See the macro documentation for details.

unsynn! {
    struct BoolKeyword(bool);
    to_tokens |s, tokens| {
        let keyword = if s.0 { "true" } else { "false" };
        Ident::new(keyword, Span::call_site()).to_tokens(tokens);
    };
}

Required Methods

fn to_tokens(&self, tokens: &mut TokenStream)

Write &self to the given TokenStream.

This is the core method that needs to be implemented. All other methods in this trait have default implementations based on this method.

Using with the unsynn! macro

The [unsynn!] macro’s to_tokens clause provides syntax sugar for implementing this method. See unsynn! documentation.

Provided Methods

fn to_token_iter(&self) -> TokenIter

Convert &self into a TokenIter object.

fn into_token_iter(self) -> TokenIter

where Self: Sized,

Convert self into a TokenIter object.

fn to_token_stream(&self) -> TokenStream

Convert &self into a TokenStream object.

fn into_token_stream(self) -> TokenStream

where Self: Sized,

Convert self into a TokenStream object.

fn tokens_to_string(&self) -> String

Convert &self into a String object. This is mostly used in the test suite to compare the outputs. When the input is a &str then this parses it and returns a normalized String.

Trait Implementations

impl Display for dyn ToTokens

implement Display using ToTokens::tokens_to_string() for all types that implement ToTokens

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

Implementations on Foreign Types

impl ToTokens for &i8

Emit a literal i8 with negative sign and without suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for &i16

Emit a literal i16 with negative sign and without suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for &i32

Emit a literal i32 with negative sign and without suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for &i64

Emit a literal i64 with negative sign and without suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for &i128

Emit a literal i128 with negative sign and without suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for &isize

Emit a literal isize with negative sign and without suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for &str

Available on crate feature proc_macro2 only.

Tokenizes a &str. Panics if the input string does not tokenize.

Example

let mut tokens = "foo -> {1,2,3}".to_token_stream();

assert_tokens_eq!(
    tokens,
    "foo -> { 1 , 2 , 3 }"
);

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for &u8

Emit a literal u8 without sign and suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for &u16

Emit a literal u16 without sign and suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for &u32

Emit a literal u32 without sign and suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for &u64

Emit a literal u64 without sign and suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for &u128

Emit a literal u128 without sign and suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for &usize

Emit a literal usize without sign and suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for &String

Available on crate feature proc_macro2 only.

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for TokenTree

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for bool

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for char

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for i8

Emit a literal i8 with negative sign and without suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for i16

Emit a literal i16 with negative sign and without suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for i32

Emit a literal i32 with negative sign and without suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for i64

Emit a literal i64 with negative sign and without suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for i128

Emit a literal i128 with negative sign and without suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for isize

Emit a literal isize with negative sign and without suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for str

Available on crate feature proc_macro2 only.

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for u8

Emit a literal u8 without sign and suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for u16

Emit a literal u16 without sign and suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for u32

Emit a literal u32 without sign and suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for u64

Emit a literal u64 without sign and suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for u128

Emit a literal u128 without sign and suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for usize

Emit a literal usize without sign and suffix

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for Group

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for Ident

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for Literal

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for Punct

fn to_tokens(&self, tokens: &mut TokenStream)

impl ToTokens for TokenStream

fn to_tokens(&self, tokens: &mut TokenStream)

impl<A, B> ToTokens for (A, B)

where A: ToTokens, B: ToTokens,

Emit tokens for a 2-element tuple by emitting each element in sequence.

Example

let mut tokens = TokenStream::new();
(42u8, true).to_tokens(&mut tokens);
assert_eq!(tokens.to_string(), "42 true");

fn to_tokens(&self, tokens: &mut TokenStream)

impl<A, B, C> ToTokens for (A, B, C)

where A: ToTokens, B: ToTokens, C: ToTokens,

Emit tokens for a 3-element tuple by emitting each element in sequence.

fn to_tokens(&self, tokens: &mut TokenStream)

impl<A, B, C, D> ToTokens for (A, B, C, D)

where A: ToTokens, B: ToTokens, C: ToTokens, D: ToTokens,

Emit tokens for a 4-element tuple by emitting each element in sequence.

fn to_tokens(&self, tokens: &mut TokenStream)

impl<T> ToTokens for Option<T>

where T: ToTokens,

fn to_tokens(&self, tokens: &mut TokenStream)

impl<T> ToTokens for [T]

where T: ToTokens,

ToTokens for arrays and slices

Example

use unsynn::*;
let arr: [Ident; 3] = [
    Ident::new("a", Span::call_site()),
    Ident::new("b", Span::call_site()),
    Ident::new("c", Span::call_site())
];
let mut tokens = TokenStream::new();
arr.to_tokens(&mut tokens);
assert_eq!(tokens.to_string(), "a b c");

fn to_tokens(&self, tokens: &mut TokenStream)

impl<T> ToTokens for Box<T>

where T: ToTokens,

fn to_tokens(&self, tokens: &mut TokenStream)

impl<T> ToTokens for Rc<T>

where T: ToTokens,

fn to_tokens(&self, tokens: &mut TokenStream)

impl<T> ToTokens for Vec<T>

where T: ToTokens,

fn to_tokens(&self, tokens: &mut TokenStream)

impl<T> ToTokens for RefCell<T>

where T: ToTokens,

fn to_tokens(&self, tokens: &mut TokenStream)

impl<T> ToTokens for PhantomData<T>

fn to_tokens(&self, _tokens: &mut TokenStream)

Implementors

impl ToTokens for GenericArgument

impl ToTokens for Type

impl ToTokens for Visibility

impl ToTokens for EndOfStream

impl ToTokens for Invalid

impl ToTokens for NonEmptyTokenStream

impl ToTokens for NonParseable

Available on crate feature nonparseable only.

impl ToTokens for Nothing

impl ToTokens for BraceGroup

impl ToTokens for BracketGroup

impl ToTokens for NoneGroup

impl ToTokens for ParenthesisGroup

impl ToTokens for LiteralCharacter

impl ToTokens for LiteralInteger

impl ToTokens for LiteralString

impl ToTokens for Disable

impl ToTokens for Enable

impl ToTokens for TokensRemain

impl ToTokens for TokenIter

impl ToTokens for AngleTokenTree

impl ToTokens for DocAttribute

impl ToTokens for GenericParams

impl ToTokens for KAsync

impl ToTokens for KDoc

impl ToTokens for KFn

impl ToTokens for KMut

impl ToTokens for KPub

impl ToTokens for KSelfKw

impl ToTokens for KTrait

impl ToTokens for KWhere

impl ToTokens for Lifetime

impl ToTokens for MethodParam

impl ToTokens for MethodParams

impl ToTokens for PathWithGenerics

impl ToTokens for RawAttribute

impl ToTokens for RefSelf

impl ToTokens for ReturnType

impl ToTokens for ServiceMethod

impl ToTokens for ServiceTrait

impl ToTokens for TypePath

impl ToTokens for TypeRef

impl ToTokens for TypeTuple

impl ToTokens for WhereClause

impl<A, B> ToTokens for Swap<A, B>

where A: ToTokens, B: ToTokens,

impl<A, B, C, D> ToTokens for Either<A, B, C, D>

where A: ToTokens, B: ToTokens, C: ToTokens, D: ToTokens,

impl<A, B, C, D> ToTokens for Cons<A, B, C, D>

where A: ToTokens, B: ToTokens, C: ToTokens, D: ToTokens,

impl<A, B, C, D> ToTokens for AllOf<A, B, C, D>

where A: PredicateOp, B: PredicateOp, C: PredicateOp, D: PredicateOp,

impl<A, B, C, D> ToTokens for AnyOf<A, B, C, D>

where A: PredicateOp, B: PredicateOp, C: PredicateOp, D: PredicateOp,

impl<A, B, C, D> ToTokens for OneOf<A, B, C, D>

where A: PredicateOp, B: PredicateOp, C: PredicateOp, D: PredicateOp,

impl<A, B, Same, Different> ToTokens for PredicateCmp<A, B, Same, Different>

where A: PredicateOp, B: PredicateOp, Same: PredicateOp, Different: PredicateOp,

impl<C> ToTokens for BraceGroupContaining<C>

where C: ToTokens,

impl<C> ToTokens for BracketGroupContaining<C>

where C: ToTokens,

impl<C> ToTokens for GroupContaining<C>

where C: ToTokens,

impl<C> ToTokens for NoneGroupContaining<C>

where C: ToTokens,

impl<C> ToTokens for ParenthesisGroupContaining<C>

where C: ToTokens,

impl<Operand, Operator, const MAX: usize> ToTokens for LeftAssocExpr<Operand, Operator, MAX>

where Operand: ToTokens, Operator: ToTokens,

impl<Operand, Operator, const MAX: usize> ToTokens for PostfixExpr<Operand, Operator, MAX>

where Operand: ToTokens, Operator: ToTokens,

impl<Operand, Operator, const MAX: usize> ToTokens for RightAssocExpr<Operand, Operator, MAX>

where Operand: ToTokens, Operator: ToTokens,

impl<Operator, Operand, const MAX: usize> ToTokens for PrefixExpr<Operator, Operand, MAX>

where Operator: ToTokens, Operand: ToTokens,

impl<T> ToTokens for NonEmptyOption<T>

where T: ToTokens,

impl<T> ToTokens for DynNode<T>

impl<T> ToTokens for Cached<T>

where T: Parse + ToTokens,

impl<T> ToTokens for Except<T>

impl<T> ToTokens for Expect<T>

impl<T> ToTokens for HiddenState<T>

where T: Default,

impl<T> ToTokens for Not<T>

where T: PredicateOp,

impl<T> ToTokens for Discard<T>

impl<T> ToTokens for Insert<T>

where T: ToTokens,

impl<T> ToTokens for IntoIdent<T>

where T: ToTokens,

Available on crate feature proc_macro2 only.

impl<T> ToTokens for IntoLiteralString<T>

impl<T> ToTokens for IntoTokenStream<T>

where T: ToTokens,

impl<T> ToTokens for Skip<T>

impl<T, D> ToTokens for Delimited<T, D>

where T: ToTokens, D: ToTokens,

impl<T, D, P, const MIN: usize, const MAX: usize> ToTokens for DelimitedVec<T, D, P, MIN, MAX>

where T: ToTokens, D: ToTokens,

impl<T, S> ToTokens for LazyVec<T, S>

where T: ToTokens, S: ToTokens,

impl<T, S> ToTokens for LazyVecUntil<T, S>

where T: ToTokens, S: ToTokens,

impl<T, const N: usize> ToTokens for StderrLog<T, N>

impl<const C1: char, const C2: char, const C3: char, const C4: char> ToTokens for Operator<C1, C2, C3, C4>

impl<const C: char> ToTokens for PunctAlone<C>

impl<const C: char> ToTokens for PunctAny<C>

impl<const C: char> ToTokens for PunctJoint<C>

impl<const V: char> ToTokens for ConstCharacter<V>

impl<const V: u128> ToTokens for ConstInteger<V>