Enum BaseToken

pub enum BaseToken<C: CharType> {
    CS(TeXStr<C>),
    Char(C, CategoryCode),
}

A BaseToken bundles the actually TeX-relevant data of a Token, which is cloned often and required by all Token implementations

Variants

CS(TeXStr<C>)

A control sequence token with the provided name

Char(C, CategoryCode)

An active character token with the provided character

Trait Implementations

impl<C: Clone + CharType> Clone for BaseToken<C>

fn clone(&self) -> BaseToken<C>

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<C: CharType> Debug for BaseToken<C>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<C: CharType> Display for BaseToken<C>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<C: PartialEq + CharType> PartialEq for BaseToken<C>

fn eq(&self, other: &BaseToken<C>) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl<C: CharType> Token for BaseToken<C>

type Char = C

fn base(&self) -> &BaseToken<C>

The actual TeX-relevant data of the Token

fn new( base: BaseToken<C>, sourceref: Option<(Ptr<String>, (usize, usize), (usize, usize))>, ) -> Self

Construct a new Token from a BaseToken

fn with_ref(&self, _: &Ptr<Self>, _: &Ptr<Command<Self>>) -> Self

Clone this Token with a new SourceReference of type SourceReference::Expansion (if the Token is a TokenWithSourceref).

fn sourceref_trace(&self) -> Option<String>

fn from_str(s: String) -> Vec<Self>

Parse a string into a list of Tokens of CategoryCode::Other

fn catcode(&self) -> CategoryCode

The CategoryCode of the Token

impl<C: CharType> StructuralPartialEq for BaseToken<C>