Enum xml5ever::tokenizer::Token

pub enum Token {
    DoctypeToken(Doctype),
    TagToken(Tag),
    PIToken(Pi),
    CommentToken(StrTendril),
    CharacterTokens(StrTendril),
    EOFToken,
    NullCharacterToken,
    ParseError(Cow<'static, str>),
}

Describes tokens encountered during parsing of input.

Variants

DoctypeToken(Doctype)

Doctype token

Tuple Fields of DoctypeToken

0: Doctype

TagToken(Tag)

Token tag founds. This token applies to all possible kinds of tags (like start, end, empty tag, etc.).

Tuple Fields of TagToken

0: Tag

PIToken(Pi)

Processing Instruction token

Tuple Fields of PIToken

0: Pi

CommentToken(StrTendril)

Comment token.

Tuple Fields of CommentToken

0: StrTendril

CharacterTokens(StrTendril)

Token that represents a series of characters.

Tuple Fields of CharacterTokens

0: StrTendril

EOFToken

End of File found.

NullCharacterToken

NullCharacter encountered.

ParseError(Cow<'static, str>)

Error happened

Tuple Fields of ParseError

0: Cow<'static, str>

Trait Implementations

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq<Token> for Token

fn eq(&self, other: &Token) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Token) -> bool

This method tests for !=.

impl Eq for Token

impl StructuralEq for Token

impl StructuralPartialEq for Token