Enum GeneratedToken 

pub enum GeneratedToken {
    Word(String),
    Punct {
        mark: char,
        spacing: GeneratedSpacing,
    },
    Text(String),
    Group {
        delimiter: GeneratedDelimiter,
        tokens: Bounded<GeneratedToken, GENERATED_TOKEN_LIMIT>,
    },
    ByteText(Vec<u8>),
    Number(u64),
    RawIdentifier(String),
    Literal(GeneratedLiteral),
}

One token a renderer writes.

A renderer states a literal’s value and never its spelling, and the quoting, the escaping, and the absence of a suffix are the tree’s business.

Ordering

The roster grows at its end and nowhere else: each arm’s slot is a byte of GeneratedTree::canonical_bytes, which is what a rendered unit’s identity is derived over.

Variants

Word(String)

An ordinary identifier-shaped word.

Punct

One punctuation character and whether it joins what follows.

Fields

mark: char

The character.

spacing: GeneratedSpacing

Whether it joins what follows.

Text(String)

A text literal, stated as its text; the quoting is the tree’s business.

Group

A delimited group.

Fields

delimiter: GeneratedDelimiter

The delimiter.

tokens: Bounded<GeneratedToken, GENERATED_TOKEN_LIMIT>

The tokens inside.

ByteText(Vec<u8>)

A byte-string literal’s material, written b"…".

Number(u64)

An unsuffixed integer literal.

RawIdentifier(String)

A raw identifier’s name without its r# spelling marker.

Literal(GeneratedLiteral)

An exact caller-authored literal admitted through GeneratedLiteral.

Implementations

impl GeneratedToken

pub fn word(spelling: &str) -> Self

One ordinary word.

pub fn raw_identifier(name: &str) -> Self

One raw identifier, stated without its r# spelling marker.

pub const fn joint(mark: char) -> Self

One punctuation mark that joins what follows.

pub const fn alone(mark: char) -> Self

One punctuation mark that stands alone.

pub fn text(content: &str) -> Self

One text literal.

pub fn byte_text(material: &[u8]) -> Self

One byte-string literal, over the material a caller holds.

pub const fn number(value: u64) -> Self

One unsuffixed integer literal.

pub const fn literal(literal: GeneratedLiteral) -> Self

One exact caller-authored literal admitted by GeneratedLiteral.

pub fn group( delimiter: GeneratedDelimiter, tokens: Vec<Self>, ) -> Result<Self, Overflow>

One delimited group.

Errors

Returns Overflow where the group carries more tokens than the declared magnitude admits.

Trait Implementations

impl Clone for GeneratedToken

fn clone(&self) -> GeneratedToken

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GeneratedToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for GeneratedToken

impl Hash for GeneratedToken

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for GeneratedToken

fn eq(&self, other: &GeneratedToken) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for GeneratedToken