Module xml5ever::tokenizer [−] [src]

XML5 tokenizer - converts input into tokens

Reexports

pub use self::interface::{StartTag, EndTag, EmptyTag, ShortTag};

pub use self::interface::{DoctypeToken, TagToken, PIToken, CommentToken};

pub use self::interface::{CharacterTokens, EOFToken, NullCharacterToken};

pub use self::interface::{ParseError};

Tokenizer states.

Attribute	A tag attribute.
Doctype	A `DOCTYPE` token. Doctype token in XML5 is rather limited for reasons, such as: security and simplicity. XML5 only supports declaring DTD with name, public identifier and system identifier
Pi	A ProcessingInstruction token.
QName	Fully qualified name. Used to depict names of tags and attributes.
Tag	XML 5 Tag Token
XmlTokenizer	The Xml tokenizer.
XmlTokenizerOpts	Copy of Tokenizer options, with an impl for `Default`.

TagKind	Tag kind denotes which kind of tag did we encounter.
Token	Describes tokens encountered during parsing of input.

Types which can receive tokens from the tokenizer.